The worst thing for them would be if someone made reasonably priced hardware that could run the ‘near enough’ models like kimi or glm 5.3 or whatever the equivalent is in the future that
the home user could buy.
I think it’s inevitable. Hardware manufacturing will ramp up to meet a demand and the demand from consumers is there. The big providers can’t monopolize a commodity forever.
The biggest hope is HBF (high bandwidth flash) which has the bandwidth of HBM with the density of flash. It has much more latency but when you’re repeatedly pumping weights through a compute unit it’s not a blocker.
loading story #50540431