Do you really think it was never the norm for rich men to have affairs? That's a very optimistic view of history, I wish I shared it.
I think it's more accurate to raise an eyebrow at the idea of powerful people not habitually having affairs (historically, most of which have been men in modern times).
Because power is an ability to do what one wants, and a lot of people want sex.
The person I responded to said "men," not "rich men." You're arguing a point that neither of us is arguing. It is perhaps historically interesting that rich people have been boning down since time immemorial, but I'd counter with the fact that rich people have also faced consequences – sometimes even lethal ones – for their affairs since time immemorial too. Having an affair is and has always been deeply frowned upon by human society as a whole, and society has always reacted by shaming the people who've been caught doing it.