Hacker News new | past | comments | ask | show | jobs | submit
I do coding evals every time a new model comes out (that I have access to) and Opus 5.5 is a touch better than Sol 6.2 right now but that’s a recent development. Prior to the 5.5 release open ai outperformed at every tier.

Sol is half the price of Opus and Luna outperforms haiku at every eval I throw at it. Haiku wasn’t even able to complete several of my evals until the newest release.

The idea that Anthropic is miles ahead of OpenAI doesn’t pass the smell test in my usage.

And that’s before the Claude vs Codex comparison (which I’ll grant is more personal preference but I find Claude to be wretched).