When your life is a constant struggle for survival/constant crysis you react you don't think. We don't typically blame someone for responding/reacting out of a place of crysis. Unless, apparently, you are a Democrat blaming the poor/working class for not embracing the party line of things are great just look at this economic report versus the guy who at least heard them (even if just to redirect/leverage their suffering into blaming out groups to gain himself power).
BTW empathy is when you can feel for those you don't relate to/have attachment to. Empathy is when you make a genuine effort to understand and connect, even across differences. It's not a concept only for people you already relate to.