Hacker News new | past | comments | ask | show | jobs | submit
mxwsn | on: Making deep learning go brrrr from first principles (2022)
No, there are more training tokens than parameters in LLMs. They are in the classical first descent setting.