Hacker News new | past | comments | ask | show | jobs | submit
pseudo-usama | on: Do transformers need three projections? Systematic study of QKV variants
It's interesting to see people are still experimenting with the core concepts of transformers