# KoboldCpp

> One-file GGUF runner with the KoboldAI UI and OpenAI-compatible endpoints.

Canonical: https://thelocalbench.com/tools/koboldcpp · Data as of 2026-10-12 · The Local Bench (thelocalbench.com), data as of 2026-10-12, CC BY 4.0

Flags: [verified] checked against primary source · [sourced] cited · [estimate] formula · [sample] placeholder

- Category: Runtimes / Desktop & CLI runtime
- Website: https://github.com/LostRuins/koboldcpp/releases/latest
- Repository: https://github.com/LostRuins/koboldcpp
- Open source: yes, AGPL-3.0 [verified] https://github.com/LostRuins/koboldcpp/blob/HEAD/LICENSE.md
- Pricing: free, starting $0 [verified] https://github.com/LostRuins/koboldcpp
- Platforms: macOS, Windows, Linux, Docker [sourced] https://github.com/LostRuins/koboldcpp#readme
- Added 2026-10-13, last verified 2026-10-13
- Sponsored: no

## Works with local models

| Integration | Status | Flag | Source |
|---|---|---|---|
| Ollama | yes | [sourced] | https://github.com/LostRuins/koboldcpp#readme |
| llama.cpp | yes | [sourced] | https://github.com/LostRuins/koboldcpp#readme |
| LM Studio | not yet confirmed | [not_measured] |  |
| OpenAI-compatible | yes | [sourced] | https://github.com/LostRuins/koboldcpp#readme |
| MCP | yes | [sourced] | https://github.com/LostRuins/koboldcpp#readme |

JSON: https://thelocalbench.com/api/v1/tools/koboldcpp.json

Logo: trademark of its owner, shown to identify the tool (source: official-repo-app-icon, https://raw.githubusercontent.com/LostRuins/koboldcpp/concedo/niko.ico).