That’s where this is going. I think we’re one year away from being able to use Opus 4.6 levels of coding performance on a 3k laptop. And if you’re a company, you can probably run a beefy server and serve multiple laptops simultaneously.
I sometimes feel like the whole industry forgot the entire mainframe vs the desktop battle that birthed the PC industry when we discuss AI.
Moore's law, even if it has had the occasional slow down or hiccup, always wins over time. 128gb or more of local memory will likely be in many cellphones within a decade.
The first iPhone had only 128mb of RAM. Today I can buy one with 12gb - in just under 20 years we got a ~9275% increase in RAM. I can get 24GB in flagship Android handsets.
Even if we only get 3000% storage space growth in the next 10 years, that still grants us all an iPhone with ~370gb of RAM. Gosh knows what high end desktops and laptops will be packing...
Of course a lot of AI processing is going to push out to the edge.
{"deleted":true,"id":48258439,"parent":48258336,"time":1779638980,"type":"comment"}