Things have gone very very fast. Two years ago, you couldn't reliably have AI write you a medium sized code project. It would spin in circles and apologize. Now, an old model can write it with only a little direction, and the programmer can have a reasonable preference against the newer model.
It seems to me open-weight models will put a floor on the pricing. They're slightly behind, but slightly behind last year meant nothing worked, now it means "just as good".
Many of my coworkers liked Opus 4.8, it was the moment they could actually use the models more reliably.
We're there, and moving forward doesn't really get us anything better. Most people are using them to format documents, spit out spreadsheets, pul together data points, and ask the models search questions.
We can already do that, it's only a matter of time before we realize we're paying 200/Mo for Jane in accounting to handle some of her work, when 5$ / Month would render the same benefit.
MOST people simply do not need frontier level intelligence.
These providers are not selling chatbots that consumers can use as personal assistants anymore. Not even selling coding assistants. They want to manage the digital layer of every industry in the world.
Maybe bigger models will always just get progressively better at writing out bigger and bigger programs to the point that we're one-shotting fully functioning operating systems with wide driver support in the future, but again these features just don't matter if that's not what you want to do.
The reason you can't one-shot something complicated is that you haven't generally considered all the important choices. You have to be asked for every choice, and complicated things have a lot of choices. But I think you can do something waterfall-esque, which used to be a big no-no in programming, if you just list out all the decisions meticulously.
I've had some success with doing that, just talking it over and thinking a lot about design decisions, making a document, and then letting it loose on the implementation. Inevitably, you find that there were contradictions or missing choices in the design, and you have to answer some questions.
So, not one-shotting, but it's my fault, not the AI's fault.
You can of course tell it to just fill in the gaps with whatever it thinks is reasonable, and then you'll have something potentially quite different from what you imagined.
I was going to comment that most of us don't need a McLaren supercar (or a Hummer) for our grocery runs -- that Prius actually is Good Enough.
ceiling