Runtimes · Inference engine
llama.cpp
The C/C++ inference engine behind GGUF; ships llama-server with an OpenAI-compatible API.
Facts
- Website
- llama.app
- Repository
- ggml-org/llama.cpp
- Open source
- Yes, MIT Verified · Source
- Pricing
- Free: Free Verified · Source
- Platforms
- macOS, Linux, Docker Sourced · Source
- Added · checked
- 2026-10-13 · 2026-10-13
- Sponsored
- No. Nobody paid for this listing or its position.
Works with local models
Summary: Our one-line paraphrase of the official description. Source.
Logo: trademark of its owner, used only to identify llama.cpp. Source (github org avatar): https://github.com/ggml-org.png?size=384, checked 2026-10-13.
