tl;dr: llama.cpp can be paired with a local coding agent called Pi via the pi-llama plugin: run `llama serve`, install the plugin, and Pi auto-discovers the model with no config or API keys, keeping all files and requests local. It runs the same binary and models across a wide range of hardware, from laptops to clusters, with hand-tuned kernels for GPUs and CPUs including Apple Silicon, RTX 5090/4090/3090, H100, A100, MI300, Intel Arc, and Jetson.