Well if one would get theological about it, I do believe they were given the land and then expelled by god. The Bible is quite explicit on that point.

I don’t remember seeing the memo that god gave “back” the land, so logically speaking they are acting against the will of god.