Hacker News new | past | comments | ask | show | jobs | submit
VRAM, not RAM. I wish it was light enough for iGPUs too
I ran the 26B model on my i5 which has no discrete graphics card. It ran about 7 tokens/sec, and appreared to be a very capable model.
loading story #48398719
loading story #48394184