Hacker News new | past | comments | ask | show | jobs | submit
wmf | on: AMD acquires Taalas to boost inference performance by etching models in silicon
That math doesn't really work.

8B model (FP4) = 4 GB DRAM = 32 Gb DRAM = 80 mm2

8B model (Taalas) = 4 GB ROM = ~800 mm2