Run your own evals then if you have this much of a need to "correctly" choose. That'll make it clear.
I'll just stick to mostly Sol on low/medium/high and start experimenting with Terra tomorrow onward to see what it does noticeably better than Luna/Deepseek flash.
Any pareto frontier model, especially from the leading labs is guarnateed to be good enough for whatever your expectations are at this point. A quick few day test should be enough for anyone to make their own conclusions.
Right, having products so poorly described that a customer needs to run their own evals to choose well is exactly what is being complained about.
{"deleted":true,"id":50251598,"parent":50249948,"time":1793051656,"type":"comment"}
Or I'm going to give up and not use any. Consumers aren't perfectly rational. This isn't like toothpaste, where, despite being overwhelmed at the store, I still need to brush my teeth so ahhhhhh fuckit and just pick a toothpaste out of the 30 available. The alternative is I keep using Google search and think AI is stupid. Or just use Facebook's thing.
> > But does Terra 6.1 beat Sol 6?
> Run your own evals then if you have this much of a need to "correctly" choose.
No. OpenAI want my money, it's on them to communicate properly.