Hacker News new | past | comments | ask | show | jobs | submit
> You serve the requests more slowly.

Thats not what Openai and Anthropic do though

Really? I have noticed times where the model simply doesn't start 'spending' tokens for a considerable period, using their official harnesses.