Hacker News new | past | comments | ask | show | jobs | submit
Yes they have quants for 32GB and 20GB use-cases (including mmproj and kv cache + context)