Humans have good spatial memory and having a handful of statically-positioned desktops in a 2D plane makes navigation intuitive and consistent.

The real issue is how the ORDER of the desktops changes all the time which messes with that spatial memory and kills a lot of the productivity improvements. A consistent straight line would still be worse than a grid, but still MUCH better than the current situation.