Hacker News new | past | comments | ask | show | jobs | submit
superb_dev | on: AMD acquires Taalas to boost inference performance by etching models in silicon
From what I remember, these chips are not mobile size yet
bradfa | parent
A small model would be. I think that’s more the point. It’s definitely not SOTA but it’s fast and energy efficient and local.
mdp2021 | root | parent | next
> A small model would be [mobile size]

A ~30mm side for the HC1 tech for an 8b model (still unclear the planned HC2)?

loading story #49203593
wmf | root | parent
Nope, a small model would be larger than the whole iPhone SoC.