So, Germany previously had Prussia, Bavaria and the rest. They were separate kingdoms, but all ethnically German.

There is something to be said of for the individual cultures being even stronger during those times. Perhaps the formation of the German nation state was a counter reaction to the Napoleonic wars?

Anyway, this has little to do with immigration from all over the world: All these kingdoms already had the same language and largely the same culture.