> Put simply: the inference pie may become so large that both client and datacenter win.

Beyond inference, even local HPC or large in-memory workloads. Steve Jobs dreamed that the NeXT Computer could be used to cure cancer in a dorm room (whatever tha tmeans), and I guess a bunch of Mac Studios chained together wouldn't be bad for a lot of computationally tough biomedical "basic science" applications.