Hacker News new | past | comments | ask | show | jobs | submit
I have yet to be convinced that LLMs can produce definitive knowledge that is not a result of combining previous information. Humans can (if they can't then science basically collapses epistemelogically, see: philosophical skepticism), but I see no evidence of LLMs doing it. And from the number of truly new ideas and concepts delivered by LLMs (exactly zero), I think it's reasonable to just treat them as induction machines for now, but to treat anything they "know" as a Gettier case.
I would like to push back on the idea that humans can provide definitive knowledge that is not a result of combining previous information.

Pretty much every single idea in science can be traced back to some combination of earlier ideas, and as they get earlier / simpler, they can be related back to some combination of direct observations.

It's not clear to me at all that our entire body of scientific knowledge can't be simply recreated by "combining results of observations + previous information". And LLMs can perform observations in addition to combine previous information, which in my estimate is genuinely sufficient for them to plausibly be able to rebuild all of science.

How can you say for sure that every effect must have a cause? How can you be any more sure about that there can't be an effect without a cause than the old believe that black swans couldn't exist that was so universally believed that it became a cliche ("rara avis in terris nigroque simillima cygno")?

If every piece of knowledge is created by combining previous ones, then no true grounded knowledge is possible. Every bit of knowledge is grounded by another bit of knowledge which is itself grounded on, ..., etc, etc.

https://plato.stanford.edu/entries/induction-problem/

loading story #48402102