I interpreted the discussion to be about LLM capabilities, reasoning, and whether they are doing something more, perhaps through emergent characteristics. Maybe that was a misunderstanding.
But anyway, sure, change "just text prediction engines" to "just token prediction engines".
Again, they are literally just that. I don't think there's anything else going on.
Token prediction is the initial way we train these models, after which we train them on much more specific tasks. And it works well enough, as you can see. It becomes a substrate on which higher-order logic and world representation emerge.
I guess it's pretty obvious where I stand. I understand them reasonably well from the math up and have implemented some toys. I don't see any magic, other than how interesting it is that much of human knowledge seems to be align along compressable patterns that can be reasonably predicted to a degree.