Hacker News new | past | comments | ask | show | jobs | submit
Like computing used to be. When I first compiled a Linux kernel it ran overnight on a Pentium-S. I had little idea what I was doing, probably compiled all the modules by mistake.
I remember that time, where compiling Linux kernels was measured in hours. Then multi-core computing arrived, and after a few years it was down to 10 minutes.

With LLMs it feels more like the old punchcards, though.

At least the compiler was free
The point of doing local inference with huge models stored on an SSD is to do it free, even if slow.