If the immigration is double the normal expected growth (~tripling the growth) it is not really tiny. It may very well be solvable, maybe even easily.
But the problem in many European countries is that "the left" does not even acknowledge that this may be a problem and should be solved leading to many people voting for "the far right" that does acknowledge that this is a problem.
In the US housing may not be the biggest issue, but the result is the same: the average voter can choose between "there is no problem, we can take in as many immigrant as we want forever" and "we don't want immigration".