Test it then.
Comprehend it using real use, or find someone you trust to use them in anger, don't wait around for the labs to do everything for you. You're the one with the leverage on where you send your money to.
If you work for a company that requires several agreements for data and legal stuff it might take weeks to set each one up. It is not like you can simply use it everywhere.
Apart from that, we always see opus dropping performance before another release, and openai started doing the same now.
It is not like you have any guarantees on what you are buying
Maybe if you spend millions per year on tokens it makes sense to test all of them.
But at rate how many models appear it would cost more for me than potential savings.
Nah, that's like trying to test drive every single car on the market, in order to buy a car.
Just buy from companies with non shitty naming systems like Anthropic, and let the shitty names go bankrupt. Free market and all that.