Maybe that's many people, but I can think of at least myself who liked him before that and didn't trust him after, so I think there's more to it than you suggest. It also followed his wife around in her political life, and she was asked about it constantly, or is she in the category of "didn't trust him before and would never have trusted or liked him"? To this day his affair and the lies thereafter are the top of what's talked about for his whole 8 years in office.