Hacker News new | past | comments | ask | show | jobs | submit
You serve the requests more slowly. Same as if your bank has a sudden rush of customers - the tellers serve them in order, and the customers wait longer. Some of the customers 'time out' (get frustrated and leave).
> You serve the requests more slowly.

Thats not what Openai and Anthropic do though

loading story #50442465
I guess there's an alternate universe where that happens
loading story #50435517