Hacker News new | past | comments | ask | show | jobs | submit
Are OpenAI's models delivering 50% (or more) completed tasks than they were last month? Are they delivering 50% more than Anthropic per token?

Nope to both. Not even close.

The only way it works is if you define "task" in a way that OpenAI is good at it and Anthropic isn't.

First of all, only the $200 plan got a cut.

Second of all, barring more cuts, yes I do think the $20 and $100 plans do deliver more tasks because the models have gotten cheaper in the meanwhile (like this very announcement).

> Are they delivering 50% more than Anthropic per token?

So say the public benchmarks. Pull up artificial analysis, “Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index”:

Sol 6.1 (max): $1,082 Opus 5.5 (max): $8,708 Sonnet 5.5 (max): $7,260

>7x difference in cost for the same tasks.

loading story #50254768