Hacker News new | past | comments | ask | show | jobs | submit
zozbot234 | on: Flash-MoE: Running a 397B Parameter Model on a Laptop
The github page mentions that you can't overlap SSD traffic and GPU compute on Apple Silicon, you get heavy contention for the shared hardware resources.