Yeah that's normal, like we short fat guys are never popular with girls. Learnt that from teenages and firmly believe that biologically people look down on each other.
societally. what amounts to attractiveness can vary a lot more than you think throughout cultures and times.
But yes, people have always been in competition biologically to flaunt success and pick the best mating partner. You can do that through putting others down or otherwise controlling a mate. And the dimorphic needs between sexes only intensifies this. I'm no sociologist but I wouldn't be surprised if this is a universal experience.