Hacker News new | past | comments | ask | show | jobs | submit
bitpush | on: Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU
is there a good tool to manage these workloads? batch process a bunch, handle failures, retry things etc?