The real cost of inference? It's dirt cheap.

Look at what it costs to serve Kimi K3.1 Pro on a B300. It suggests margins of 98-99% at API prices for OpenAI and Anthropic.

Should the shortages for memory and GPUs ever improve, this will only become much cheaper, won't it?

That said, R&D is another story.