> If you're using Claude via Anthropic's SaaS service it's near impossible to collect logs of what actually happened in a user's session.

If you are big into logs, OpenAI might be more your speed. They've got an extremely good logging UI in their platform web app. I use it all the time to figure out what the hell copilot was thinking.