Xenophobia is about assuming that people are different because of their national origin. It's not "xenophobia" if there are actual differences, especially if there are actual changes to someone's society. Treating all cultural differences as equally desirable is cultural relativism. Not everyone who rejects cultural relativism is xenophobic. You're allowed to prefer your own culture and to live in a society that reflects your culture. The countries that most immigrants come from treat that principle as axiomatic.