There were two (expensive) exceptions / alternatives so far: Bedrock and Vertex. Their Zero Data Retention was in fact contractually enforced. Now it is all f...d because of these morons at Anthropic. For now I am better off just using DS via their API.
This is just a tragic moment for Tech. We just killed AI privacy. OpenAI already follows this trend and others will do too.
The only hope now is ... tada .. Mistral LOL
Hmmm no? The only way is to deploy your own local model, using anyone else's you are at their whim on what happens to your data.
And blindly trust thousands of unknown python developers?
The only way to really be sure is to build it from scratch starting with your own silicon wafers.
But for those who are a little more pragmatic, AWS has a good track record of fulfilling their promises.
It’s not binary. With AWS previously you have contractual guarantees with a third party, that’s been in business for a couple decades, which explicitly state zero seconds of data retention - only as long as needed for inference.
Consider the security angle too. You now have to rely on Anthropic’s infrastructure security. You did not previously when you used Bedrock/Vertex/etc.