Hacker News new | past | comments | ask | show | jobs | submit
Shouldn't it correlate pretty strongly with price? Like, model size is literally the amount of memory / compute it takes to elect each token.

Agree there is no direct relation to quality - a Fable whose weights have been totally randomized would be the same size and cost the same amount to run.

if you think companies are charging something which in any way corresponds to the cost per token I have an IPO to sell you.