You serve the requests more slowly. Same as if your bank has a sudden rush of customers - the tellers serve them in order, and the customers wait longer. Some of the customers 'time out' (get frustrated and leave).
> You serve the requests more slowly.
Thats not what Openai and Anthropic do though
loading story #50442465