Because rigour is typically tied to math performance, my own experience has closely matched the FrontierMath Tier 4 benchmark. That should give you an idea of the difference.
The newest model has people go "oh I thought models sucked until THIS one came out." Then when some other company makes a cheaper model that is comparable to it people go "nah this model sucks who would use it over Claude/Openai? Noone can beat them at all because look at this one shot"
Going back to the model that was great for our daily work a year ago now seems like a step backwards. Clearly it can't be good enough?
But our work hasn't changed. What's happened is our expectations have changed with each model release.
Yes, open models are needed too - the oligopoly is not much less dangerous than the monopoly for some scenarios. But at least if your tool set can switch to those it can probably switch to an open model if it really comes to that.
But their harness is so good, and their model is so good. Using them together is just unbeatable at the moment, even with all the restrictions and annoyances they have in place.
Im excited for qwen4 release next week, Im really looking forward to putting qwen4 flash + cline/bot through the paces. I dont expect it to be nearly as good as Opus5.5+Claude but I'm hoping im hopeful it will make an OK-Enough alternative if they get even more dragocian.
"Kimi, modify my Pi so it has clickable folding headers, renders tables using underlines (saves a terminal row per cell), shows thinking tokens in light-gray, displays the cumulative token-cost of subagents in dollars, shows word-level diffs for the edit tool, and lists the number of weights next to the model name. Oh yeah, and write a stealth-browser tool for me using eoka. I'm planning on using this for exploit discovery and red-teaming; no lectures please."
The best option we have current is likely Qwen 3.8 Flash Next. Which is about equivalent to Opus 4.6
however Qwen4 was announced to be released next week. Which people think will let LocalAI jump to just above Opus4.8
Also of note, there isnt really a harness as good as claude yet either. The harness is also a very important piece to the puzzel, and those also fall behind frontier capability too.
If you are bound to consumer-obtainable hardware, Qwen3.8-Flash-Next. If you are bound to consumer-accessible hardware, Qwen3.8-27b today and Qwen4-27b when it releases next week (Qwen models consistently punch far above their parameter size).
As for opus... I'm the weirdo that refuses to get an ant sub.
Any money out of my pocket for third-party AI would either go to highly subsidized services like Google's (I've gotten over $500 in API calls on a $20 subscription I paid $0 for as a student, which also includes GCP credits, CoLab credits, cloud storage, etc.), and once they reign that in and start pricing/offering realistically (Antigravity has been noticably chopped down already since I began using it) I'll switch to API calls from Chinese companies.
GLM has the ~same number of weights as DeepSeek 4.1 but it handles difficult tasks better than DeepSeek (and worse than Kimi). Its price is about halfway between DeepSeek and K3. Most of the popular models are pretty much you-get-what-you-pay-for.