Hacker News new | past | comments | ask | show | jobs | submit
selcuka | on: Edge0-145B: Frontier AI Capabilities on Your Own Computer
For some reason the engine that can run the 120B/145B models (edge0-strata) only seems to support CUDA for now:

https://github.com/Edge0-AI/Edge0/tree/main#platforms