Hacker News new | past | comments | ask | show | jobs | submit
ariwilson | on: Claude Fable 5.2 and Mythos 5.2
Correct. But the 5% more solves and 3-5% fewer tokens are within the noise of previous eval runs I've done on models. The faster response time is not.
Spivak | parent
Someone using an actual statistical test to quantify if there's actual measurable improvement?! An angel among men.
loading story #50431880