Hacker News new | past | comments | ask | show | jobs | submit
Taking the benchmarks in the article at face value, this is ~on par with Opus 5.5 for ~1/4 the price!
Which is why I don't take the benchmarks at face value...
loading story #50248479
Taking the benchmarks (as reported by OpenAI) at face value, why wouldn't they show Opus 5.5 on the OS world benchmark, and show no Anthropic models at all on the "factual error rate" benchmark
...no it's not? At max effort, it scores 50% on terminal bench vs. Opus 5.5's 70%.
loading story #50248470