If every software developer paid $200/month
That's significantly underestimating the potential. Companies typically spend $200k/year for developers (salary, benefits, taxes, equipment, office space...). If AI can make them even 25% more productive, that would justify $50k/year in tokens.
I more than agree on the value, but not on the price. There's currently a competitive market, including free models that are pretty impressive if not "frontier".
I don't think LLM inference is ever going to stop being a competitive market, though. Unless regulation or other factors make the existing players form a cartel.
I think it's pretty safe to say that, unless the government steps in to prevent it, they will form a cartel or some sort of oligopoly. The incentives for them to do so are very high.
loading story #50422420