Hacker News new | past | comments | ask | show | jobs | submit
I'm by no means anti-anything but I think what the comments are getting at is that these "world models" do not have a world model. It's a fundamental qualitative gap that no amount of compute has been able to close, just mask by everything else getting better.

This doesn't show up as much where the verifiable reward is "code compiles and tests pass" but you can still absolutely see it in things like movies, prose, or slide decks. Even frontier models are pretty bad at keeping track of narrative threads even as the technical quality drastically improves.

This begs the question of whether the gap can be closed just with more compute (presumably yes, or at least errors can be minimized beyond human capacity to see them) and is that going to be worth it with current tech (possibly no).

does your model of models admit the possibility of partial models?

the average human cannot vividly recollect a walk through a familiar neighborhood, much less invoke a coherent fantasy of going on such a walk. do they contain a world model?

loading story #50270633