Hacker News new | past | comments | ask | show | jobs | submit
> Magnitudes more data taken in than any language model.

Ah, yes, I can fondly recall reading and internalizing every word available on the internet when I was young...

You should check out how much raw data just your eyes process for every second they're open (although a significant amount is discarded before it gets to the vision center, but still). Then consider the other senses also constantly doing their thing.
The vast majority of people don't internalize most things. Some internalize even less. It can become a big issue with things like dissociative disorders. (I have some experience with that)
LLMs don't internalize per se (assuming something akin to conscious intent). The foundation of a model is comparable to a human's daily experiences of just being, then the fine-tuning is comparable to formal schooling, and finally the prompting is comparable to meetings for workplace tasks.
I said nothing of LLMs. I don't compare the process of LLM training to any form of human education because they are fundamentally dissimilar. LLMs are engineered mathematics and cannot self-train yet.
There are of course parallels. Anyone who's done ML should be able to see it at least. But yes, there are fundamental differences in methodology due to the mode and level of access: with a human, the only way is to go through the senses and there's no - easy - way to affect the learning substrate; with a LLM, data is directly injected into the substrate, which is also human-architected.
A picture is worth a thousand words. How much video data was your brain trained on?