Hacker News new | past | comments | ask | show | jobs | submit
Artificial Analysis index results are up, since multiple people are asking: https://artificialanalysis.ai/models/kimi-k3-1-pro

It's 55, at 4th overall, beating both GPT-6 Astra and Fable 5.1. It's also faster than both.

> When evaluating the Intelligence Index, it generated 150M tokens, which is very verbose in comparison to the median of 87M.

> When evaluating the Intelligence Index, it generated 150M tokens, which is very verbose in comparison to the median of 87M.

This is 100M fewer than Opus 5.5, 40M fewer than Fable 5.1, and about a third of Sonnet 5.5. In the top-6, it's 3rd, beaten by Muse Wonder at 140M and Astra at, impressively, just 60M.

loading story #50213854
loading story #50218144
Muse Wonder is even higher, and there is no way in hell it's better in practice than either Astra or Fable.
loading story #50214275
From that link:

> reasonably priced when comparing to other models of similar price

???

loading story #50216587
> beating both GPT-6 Astra and Fable 5.1. It's also faster than both.

Very similar to my adversarial programming language (KillSwitch) benchmark[1], at least on pass rate, it is much slower though.

1 - https://bench.killswitch-lang.org

loading story #50215358
{"deleted":true,"id":50213375,"parent":50213093,"time":1792780017,"type":"comment"}
I don't trust these Artificial Analysis indexes and I'm not sure why anyone considers them authoritative, the site just sprung up a few months ago and now everyone quotes it?

From my own use of the models I find their ranking to be totally inaccurate.

loading story #50216772
loading story #50214303
loading story #50214353
loading story #50218917
loading story #50214257
while this is an awesome model, I have a bridge to sell to folks who think (based on AA leaderboard) that this is better than Opus 5.5
> When evaluating the Intelligence Index, it generated 150M tokens, which is very verbose in comparison to the median of 87M.

So their base price is 1/5th of Opus 5.5 per token, but if you want "highspeed" it's 2x that and then I guess it generates 2x the number of tokens as well?

That might suggest that Opus is competitively priced after all.

loading story #50213386
loading story #50213369