Best would be a free week/month for anyone who sent a request during the downtime.
This is bizarrely out of touch. It would be a courtesy but it's not a "reasonable expectation" at all.
At best you could maybe reasonably expect a prorated refund for the time of unavailability, but then Fable was still available.
Instead you should be compensated for your losses - the time and money it took you to repair that tyre.
Same with a web service. If I pay for 24 * 7 service and it's not working when I go to use it, I want compensation for my time and effort resolving the matter.
For some that'll be small - eg. Searching Google instead, taking 30 seconds. For others it'll be a big headache.
But downtime of 1 hour is almost certainly more costly for the consumer than 1/30/24 * subscription price.
Your contract doesn't have an SLA. If you are important enough, you can certainly negotiate one - and it will be far more expensive than your prosumer subscription.
And even then you will not get a 1:168 or 1:720 SLA like you are expecting - that's simply ludicrous and totally out of touch with every reality. Even if you were a lucrative enterprise customer (which you are not) they'd tell you to get lost.
> If there is a hole in the street and you fall down it, you wouldn't expect a refund just for the 1 second
Actually, you wouldn't get a refund at all unless you suffer damage or injury, which is an high bar to prove in court and a totally separate ball game.
Enough to offset any KV cache miss expenses is the absolute minimum.
The smart play is to refund customers something like $20-50 worth of unsubsidized credits.
Those are high margin and only the equivalent of 45 minutes of Fable usage once the KV cache reload costs are factored in.
Yet customers often need a few credits to finish a job without waiting 5 hours or days for their reset.
Keep in mind openAI already gives me free resets I can use when I want which are very useful to me. Seems a no brainer to tack those to subscriptions, actually.
It gives the user a little more flexibility, a little more control over their tools.
I wish it didn’t go down so frequently, but it does. Still, I get an enormous amount of value. I realize they probably prioritize API users over subscribers and I’m ok with that. I use the API and openrouter for the things that need to be resilient to outages.
I would be embarrassed to try to ask for a refund or free credits. They already give credits far in excess of what you pay for and you have practically the entire month to use them outside of a couple hours of downtime.
When you miss 1h of your job, do you give back a month for free?