I wonder why they didn't show Gemini 4 Carbon's scores on the science benchmarks, especially since Google seems to be pushing it for that -
https://x.com/pushmeet/status/2120814064863461440?s=20
(FD: Google employee, I don't work on Gemini)
I work at OpenAI and I made the plots. Gemini 4 Carbon was omitted when we couldn’t find public data, usually cost. No intent to hide anything.
If we missed anything, feel free to point me to it and we can add it.
loading story #50536071
they are probably trying to authenticate their phone number to access agy
Probably still waiting for it to finish reasoning on the benchmark. Should be ready in a week or two.
Yeah it feels shady how Carbon was selectively plotted (or not), unlike Opus/Fable
Two posibilities.
1. They couldn't figure out how to actually use those Google models.
2. They launched the benchmark days ago and Gemini is still rereading the file with tasks.