Hacker News new | past | comments | ask | show | jobs | submit
great to hear, which quant + KV quant + KV size are you on? is it llama.cpp?