Hacker News new | past | comments | ask | show | jobs | submit
cyanydeez | on: AirLLM 70B inference with single 4GB GPU
in theory, QWEN3.6-35B-A3B should run as fast as a 3B model; and in practice, it can be just as dumb.