I dunno. You still have to test, but in my experience if I noticed unreliability during high load I could just tell Claude "I noticed unreliability during high load" and it would easily have set up a high load benchmark, discovered this broadcast channel issue and fixed it.

It definitely improves the results if you do think but I don't think "you still have to think" is a safe space that's going to save us from unemployment.