I hope you understand the affair with the spy does not strictly matter, but he is in fact being fired because of the affair with a subordinate.

Like everyone, they have a COC/sexual harassment policy, and that is basically always a firing offense in practice. They cannot place him above it, or else they would be in for infinite liability.

This is why literally nothing mentioned firing until that was discovered, and then it instantly became about firing him.