Skip to main contentThe Local Bench

Runtimes · Desktop & CLI runtime

KoboldCpp

One-file GGUF runner with the KoboldAI UI and OpenAI-compatible endpoints.

Facts

Website
github.com/LostRuins/koboldcpp/releases/latest
Repository
LostRuins/koboldcpp
Open source
Yes, AGPL-3.0 Verified · Source
Pricing
Free: Free Verified · Source
Platforms
macOS, Windows, Linux, Docker Sourced · Source
Added · checked
2026-10-13 · 2026-10-13
Sponsored
No. Nobody paid for this listing or its position.

Works with local models

Ollama
Yes Sourced · Source
llama.cpp
Yes Sourced · Source
LM Studio
Not yet confirmed Not yet measured
OpenAI-compatible
Yes Sourced · Source
MCP
Yes Sourced · Source