Hacker News new | past | comments | ask | show | jobs | submit

A tiny world model running games on a Raspberry Pi Pico 2 W

https://github.com/SheepSeb/tinyworldformer
I might have missed it in the readme, but what hardware did the training take place on? This is really neat.
loading story #50297422
This is incredibly cool! Fascinating to see looped transformers be necessary for mini-Doom, but not for simpler games.
Very cool. I didn't know NNs were capable of such determinism, that's very interesting. Is this a similar effect to overfitting? Also, it's the same model for all the games, right?
loading story #50296584
loading story #50296622
{"deleted":true,"id":50295451,"parent":50295450,"time":1793305948,"type":"comment"}
Honestly fascinating. I almost feel like you'd be better off avoiding any discussion of the fact that this runs on a Raspberry Pi Pico 2 W because it takes away from the crazy world model capabilities (of course, the fact that this does run on a Pico 2 makes the whole thing much more impressive).

There's gotta be a good way to incorporate this logic into a larger, more "traditional" game in a meaningful way. Seems like an approach for procedural generation that could solve some of the issues usually found with actual procedural generation.