Hacker News new | past | comments | ask | show | jobs | submit
zxexz | on: Do transformers need three projections? Systematic study of QKV variants
Not to sound facetious, but perhaps enough runs at different param/token sizings to define a curve?