Hacker News new | past | comments | ask | show | jobs | submit
unglaublich | on: They’re made out of weights
Linear algebra can indeed not do it. You need non-linearity to get the expressivity that we see in LLMs.