Hacker News new | past | comments | ask | show | jobs | submit
That terminal bench 4.0 result is... bad? Terra XHigh more expensive than Sol Low and still does worse.

It's very likely this is a next checkpoint of GPT-6 "Sol", over-optimised for the web chat and offered to Codex subscribers as a "please go away" offering.

If this was half the price, I'd be very interested, but at 1/5/0.05? Feels like another panic release because they can't get Astra 6.1 out of the door...

Scoring "bad" on Terminal Bench 4.0 can also be a sign that it's cheating less: https://preferencemodel.com/blog/terminal-bench-4-is-saturat...