Hacker News new | past | comments | ask | show | jobs | submit
And if you're running it on a dGPU, power limit it, because you lose very little in terms of token generation performance, since it's memory-bound.