The problem isn't the people, it's the policy.

e.g. https://4w.pub/male-inmate-charged-with-raping-woman-inside-...

The only reason this could happen is because of policy that prioritizes self-declared "gender identity" over sex, and over women's dignity and safety. That's the actual problem, not people just quietly living their lives.