It’s pretty common in the security world to have a red team and a blue team. There is overlap in the skillset for both, but there are good reasons to have separate people develop each team, and we wouldn’t expect people to have a talent for both.
Ideally, we like it if the red team can suggest solutions, but that’s not always their job or expertise and I’ve rarely if ever heard someone express the sentiment you are within that context by suggesting a really good red team person isn’t useful if they can’t fix the holes they find.
Right, but if one of my teams, red or blue, was just saying "the other teams could be flawed", I would probably push for a new makeup for that team?
This is true but it's worth pointing out that the currency of red teaming is the POC, and the authors of the Stochastic Parrots paper don't have one.