I use a nix one-liner to run llama.cpp on M5.
``` nix run nixpkgs#llama-cpp -- server --models-dir models -m models/gemma-4-12B-it-Q8_0.gguf --port 8080 ```
open http://localhost:8080.
I also run pi in a docker container to do some vibe agentic coding. But I prefer `cat flake.nix | pbcopy` and paste into the browser. Then I can export the jsonl files and use tools to convert them to md and push to GitHub Pages.
I can do most of AI sessions off-line and only need hotspot to sync with GitHub.
My main use case is to learn and hack nix on Mac. It is fun.