If you are that reliant on LLMs for your workflow, then how do you not have any redundancy in place? Assuming you've have any kind of basic abstraction in place, swapping in API keys for a different provider should be a simple config change...
> If you are that reliant on LLMs for your workflow, then how do you not have any redundancy in place?
You could ask that question about the MS outage as well and million other things.
I suppose I can't understand because where I work our scale is small enough that we can have an actually resilient infrastructure and can stay in control of almost everything we need, and when you get bigger it's more difficult? I mean, even an outage from our email provider could be worked around in a matter of a couple hours at most.
I'm really not sure it's not just because most managers are clueless and shortsighted though.
loading story #50482714
Depending on company size and security posture (like mine), we only have one provider claude and the company outright bans all other ones, even local models unless approved via a lengthy process
loading story #50483400
There are already entire companies out there without a single human who has any idea how their systems are implemented, let alone being able to manually fix them. This problem will only worsen with time.
Unless these were meetings about how they would enable redundancy soon with the help of $llm