One of the strangest things in the AI industry is 'tokenomics'. It's not very clear why using GPT-4 in early 2023 was so expensive and then six months later 20 bucks could get you a fair amount of GPT-4 inference. This pattern has continued across various labs/providers for years--there is a continuous see-saw of pricing that doesn't seem related to anything.
So what open weight models do is at least provide a baseline of inference cost to add some sanity to the price markers. And of course predictability too--if you really want Kimi K2 instead of K3 you can still use it.
So the competitive pressure and predictability offered by open models is helpful for users
loading story #49049980
loading story #49049475
> It's not very clear why using GPT-4 in early 2023 was so expensive and then six months later 20 bucks could get you a fair amount of GPT-4 inference.
FlashAttention was a hell of a drug.
loading story #49050698
Why do prescription medications cost so much, and generics so little (comparatively)?
Artificial inflation to recoup R&D.
loading story #49049489
loading story #49049623
loading story #49050170
loading story #49050594
Its very clear: nobody wanted to pay for usage at that price point
loading story #49050256
loading story #49049762
loading story #49049543
loading story #49049398