# Tools for local models

> Runtimes, chat apps, coding agents, frameworks, design and ops tools that work with local models. Every fact links to an official source. Order is editorial; sponsorship never changes it.

Canonical: https://thelocalbench.com/tools · Data as of 2026-10-12 · The Local Bench (thelocalbench.com), data as of 2026-10-12, CC BY 4.0

Flags: [verified] checked against primary source · [sourced] cited · [estimate] formula · [sample] placeholder

JSON: https://thelocalbench.com/api/v1/tools.json · New this month: https://thelocalbench.com/tools/new.json

| Tool | Category | Pricing | Licence | Works with (confirmed) | Sponsored |
|---|---|---|---|---|---|
| [exo](https://thelocalbench.com/tools/exo.md) | Runtimes / Distributed cluster | free: Free | Apache-2.0 | Ollama, OpenAI-compatible | no |
| [KoboldCpp](https://thelocalbench.com/tools/koboldcpp.md) | Runtimes / Desktop & CLI runtime | free: Free | AGPL-3.0 | Ollama, llama.cpp, OpenAI-compatible, MCP | no |
| [llama.cpp](https://thelocalbench.com/tools/llama-cpp.md) | Runtimes / Inference engine | free: Free | MIT | llama.cpp, OpenAI-compatible | no |
| [llamafile](https://thelocalbench.com/tools/llamafile.md) | Runtimes / Single-file runtime | free: Free | Apache-2.0 | llama.cpp | no |
| [LM Studio](https://thelocalbench.com/tools/lm-studio.md) | Runtimes / Desktop app | free: Free | closed source | LM Studio, OpenAI-compatible, MCP | no |
| [MLX LM](https://thelocalbench.com/tools/mlx-lm.md) | Runtimes / Apple Silicon runtime | free: Free | MIT | OpenAI-compatible | no |
| [Ollama](https://thelocalbench.com/tools/ollama.md) | Runtimes / Desktop & CLI runtime | free: Free | MIT | Ollama, llama.cpp, OpenAI-compatible | no |
| [SGLang](https://thelocalbench.com/tools/sglang.md) | Runtimes / Inference server | free: Free | Apache-2.0 | OpenAI-compatible | no |
| [vLLM](https://thelocalbench.com/tools/vllm.md) | Runtimes / Inference server | free: Free | Apache-2.0 | llama.cpp, OpenAI-compatible | no |
| [AnythingLLM](https://thelocalbench.com/tools/anythingllm.md) | Chat & workspaces / Desktop & self-hosted | freemium: Free tier · paid plans | MIT | Ollama, llama.cpp, LM Studio, OpenAI-compatible, MCP | no |
| [Jan](https://thelocalbench.com/tools/jan.md) | Chat & workspaces / Desktop app | free: Free | Apache-2.0 | llama.cpp, OpenAI-compatible, MCP | no |
| [LibreChat](https://thelocalbench.com/tools/librechat.md) | Chat & workspaces / Self-hosted web UI | free: Free | MIT | Ollama, OpenAI-compatible, MCP | no |
| [LobeHub](https://thelocalbench.com/tools/lobehub.md) | Chat & workspaces / Self-hosted web UI | freemium: Free tier · $9.90–$39.90 / month (cloud) | LobeHub Community License (Apache-2.0-based) | OpenAI-compatible, MCP | no |
| [Open WebUI](https://thelocalbench.com/tools/open-webui.md) | Chat & workspaces / Self-hosted web UI | open-core: Free to self-host · paid tiers | Open WebUI License (BSD-3-based, branding clause) | Ollama, llama.cpp, LM Studio, OpenAI-compatible, MCP | no |
| [Text Generation Web UI](https://thelocalbench.com/tools/textgen-webui.md) | Chat & workspaces / Desktop app | free: Free | AGPL-3.0 | llama.cpp, MCP | no |
| [Aider](https://thelocalbench.com/tools/aider.md) | Coding agents / Terminal agent | free: Free | Apache-2.0 | Ollama, LM Studio, OpenAI-compatible | no |
| [Cline](https://thelocalbench.com/tools/cline.md) | Coding agents / IDE extension | free: Free | Apache-2.0 | Ollama, LM Studio, OpenAI-compatible, MCP | no |
| [Continue](https://thelocalbench.com/tools/continue.md) | Coding agents / IDE extension | open-core: Free to self-host · paid tiers | Apache-2.0 | Ollama, llama.cpp, MCP | no |
| [goose](https://thelocalbench.com/tools/goose.md) | Coding agents / Desktop & CLI agent | free: Free | Apache-2.0 | Ollama, MCP | no |
| [Kilo Code](https://thelocalbench.com/tools/kilo-code.md) | Coding agents / IDE extension | freemium: Free tier · $15 / user / month (Teams) | MIT | Ollama, LM Studio, MCP | no |
| [OpenCode](https://thelocalbench.com/tools/opencode.md) | Coding agents / Terminal agent | freemium: Free tier · Pay as you go (Zen, $20 top-up) | MIT | Ollama, llama.cpp, LM Studio, MCP | no |
| [OpenHands](https://thelocalbench.com/tools/openhands.md) | Coding agents / Autonomous agent | open-core: Free to self-host · paid tiers | MIT | Ollama, LM Studio, MCP | no |
| [Tabby](https://thelocalbench.com/tools/tabby.md) | Coding agents / Self-hosted assistant | open-core: Free tier · $19 / seat / month (Team) | Apache-2.0 core + proprietary ee/ | Ollama, llama.cpp | no |
| [Zed](https://thelocalbench.com/tools/zed.md) | Coding agents / Code editor | freemium: Free tier · $10–$30 / month | GPL-3.0 / Apache-2.0 (per crate) | OpenAI-compatible, MCP | no |
| [Agno](https://thelocalbench.com/tools/agno.md) | Agent frameworks / Agent runtime | open-core: Free tier · $150 / month (Pro control plane) | Apache-2.0 | Ollama, LM Studio, MCP | no |
| [AutoGen](https://thelocalbench.com/tools/autogen.md) | Agent frameworks / Multi-agent | free: Free | CC-BY-4.0 | Ollama, OpenAI-compatible, MCP | no |
| [CrewAI](https://thelocalbench.com/tools/crewai.md) | Agent frameworks / Multi-agent | open-core: Free to self-host · paid tiers | MIT | Ollama, LM Studio, OpenAI-compatible, MCP | no |
| [LangGraph](https://thelocalbench.com/tools/langgraph.md) | Agent frameworks / Orchestration | open-core: Free tier · $39 / seat / month (LangSmith Plus) | MIT | Ollama, MCP | no |
| [Letta](https://thelocalbench.com/tools/letta.md) | Agent frameworks / Memory & state | open-core: Free tier · $20 / month (Pro, cloud) | Apache-2.0 | Ollama, LM Studio | no |
| [LlamaIndex](https://thelocalbench.com/tools/llamaindex.md) | Agent frameworks / RAG & documents | open-core: Free to self-host · paid tiers | MIT | Ollama, MCP | no |
| [Pydantic AI](https://thelocalbench.com/tools/pydantic-ai.md) | Agent frameworks / Typed SDK | free: Free | MIT | Ollama, OpenAI-compatible, MCP | no |
| [smolagents](https://thelocalbench.com/tools/smolagents.md) | Agent frameworks / Code agents | free: Free | Apache-2.0 | Ollama, OpenAI-compatible, MCP | no |
| [MCP reference servers](https://thelocalbench.com/tools/mcp-servers.md) | MCP & protocols / Reference servers | free: Free | Apache-2.0 (transitioning from MIT) | MCP | no |
| [ComfyUI](https://thelocalbench.com/tools/comfyui.md) | Image & design / Node-graph studio | freemium: Free tier · $20–$100 / month (Comfy Cloud) | GPL-3.0 | — | no |
| [InvokeAI](https://thelocalbench.com/tools/invokeai.md) | Image & design / Canvas studio | free: Free | Apache-2.0 | llama.cpp | no |
| [Langfuse](https://thelocalbench.com/tools/langfuse.md) | Ops & evals / Observability | open-core: Free tier · $29–$2,499 / month (cloud) | MIT core + proprietary ee/ | Ollama, MCP | no |
| [LiteLLM](https://thelocalbench.com/tools/litellm.md) | Ops & evals / Gateway | open-core: Free to self-host · paid tiers | MIT core + proprietary enterprise/ | Ollama, LM Studio, OpenAI-compatible, MCP | no |
| [promptfoo](https://thelocalbench.com/tools/promptfoo.md) | Ops & evals / Evals & red teaming | open-core: Free to self-host · paid tiers | MIT | Ollama, llama.cpp, MCP | no |
| [Dify](https://thelocalbench.com/tools/dify.md) | Workflow automation / LLM app platform | open-core: Free tier · $590–$1,590 / workspace / year (cloud) | Dify Open Source License (modified Apache-2.0) | OpenAI-compatible, MCP | no |
| [n8n](https://thelocalbench.com/tools/n8n.md) | Workflow automation / Visual workflows | open-core: Free to self-host · paid tiers | Sustainable Use License (fair-code) | Ollama, MCP | no |
