Best would be a free week/month for anyone who sent a request during the downtime.
This is bizarrely out of touch. It would be a courtesy but it's not a "reasonable expectation" at all.
At best you could maybe reasonably expect a prorated refund for the time of unavailability, but then Fable was still available.
Enough to offset any KV cache miss expenses is the absolute minimum.
The smart play is to refund customers something like $20-50 worth of unsubsidized credits.
Those are high margin and only the equivalent of 45 minutes of Fable usage once the KV cache reload costs are factored in.
Yet customers often need a few credits to finish a job without waiting 5 hours or days for their reset.
Keep in mind openAI already gives me free resets I can use when I want which are very useful to me. Seems a no brainer to tack those to subscriptions, actually.
It gives the user a little more flexibility, a little more control over their tools.
I wish it didn’t go down so frequently, but it does. Still, I get an enormous amount of value. I realize they probably prioritize API users over subscribers and I’m ok with that. I use the API and openrouter for the things that need to be resilient to outages.
I would be embarrassed to try to ask for a refund or free credits. They already give credits far in excess of what you pay for and you have practically the entire month to use them outside of a couple hours of downtime.
When you miss 1h of your job, do you give back a month for free?
I think Anthropic is past this point. They are trying to get to profitability. They literally don't have enough compute to serve their demand.
OpenAI on the other hand I can totally see doing this. They need to gain marketshare and gain it fast or they're screwed.