But even then. If you close a terminal, it'll jump to some random terminal on another desktop. It just doesn't make any sense.
It doesn't make a lot of sense to me as a default, but there's an option to turn off the automatic switching of spaces when switching applications, and it pretty much eliminates the unwanted switches from closing the last window on the current space.