40 tools · checked 2026-10-13
Tools for local models
Runtimes, chat apps, coding agents, frameworks, design and ops tools that work with models on your own hardware. Every licence, price and integration links to the official source; anything we could not confirm says so.
Tools
Select a row's chevron for the summary, price and links.
| Details | Tool | Category | Pricing | Licence | Works with |
|---|---|---|---|---|---|
| exo | Runtimes Distributed cluster | Free | Apache-2.0 | ||
| KoboldCpp | Runtimes Desktop & CLI runtime | Free | AGPL-3.0 | ||
| llama.cpp | Runtimes Inference engine | Free | MIT | ||
| llamafile | Runtimes Single-file runtime | Free | Apache-2.0 | ||
| LM Studio | Runtimes Desktop app | Free | Closed source | ||
| MLX LM | Runtimes Apple Silicon runtime | Free | MIT | ||
| Ollama | Runtimes Desktop & CLI runtime | Free | MIT | ||
| SGLang | Runtimes Inference server | Free | Apache-2.0 | ||
| vLLM | Runtimes Inference server | Free | Apache-2.0 | ||
| AnythingLLM | Chat & workspaces Desktop & self-hosted | Freemium | MIT | ||
| Jan | Chat & workspaces Desktop app | Free | Apache-2.0 | ||
| LibreChat | Chat & workspaces Self-hosted web UI | Free | MIT | ||
| LobeHub | Chat & workspaces Self-hosted web UI | Freemium | LobeHub Community License | ||
| Open WebUI | Chat & workspaces Self-hosted web UI | Open core | Open WebUI License | ||
| Text Generation Web UI | Chat & workspaces Desktop app | Free | AGPL-3.0 | ||
| Aider | Coding agents Terminal agent | Free | Apache-2.0 | ||
| Cline | Coding agents IDE extension | Free | Apache-2.0 | ||
| Continue | Coding agents IDE extension | Open core | Apache-2.0 | ||
| goose | Coding agents Desktop & CLI agent | Free | Apache-2.0 | ||
| Kilo Code | Coding agents IDE extension | Freemium | MIT | ||
| OpenCode | Coding agents Terminal agent | Freemium | MIT | ||
| OpenHands | Coding agents Autonomous agent | Open core | MIT | ||
| Tabby | Coding agents Self-hosted assistant | Open core | Apache-2.0 core + proprietary ee/ | ||
| Zed | Coding agents Code editor | Freemium | GPL-3.0 / Apache-2.0 | ||
| Agno | Agent frameworks Agent runtime | Open core | Apache-2.0 | ||
| AutoGen | Agent frameworks Multi-agent | Free | CC-BY-4.0 | ||
| CrewAI | Agent frameworks Multi-agent | Open core | MIT | ||
| LangGraph | Agent frameworks Orchestration | Open core | MIT | ||
| Letta | Agent frameworks Memory & state | Open core | Apache-2.0 | ||
| LlamaIndex | Agent frameworks RAG & documents | Open core | MIT | ||
| Pydantic AI | Agent frameworks Typed SDK | Free | MIT | ||
| smolagents | Agent frameworks Code agents | Free | Apache-2.0 | ||
| MCP reference servers | MCP & protocols Reference servers | Free | Apache-2.0 | ||
| ComfyUI | Image & design Node-graph studio | Freemium | GPL-3.0 | ||
| InvokeAI | Image & design Canvas studio | Free | Apache-2.0 | ||
| Langfuse | Ops & evals Observability | Open core | MIT core + proprietary ee/ | ||
| LiteLLM | Ops & evals Gateway | Open core | MIT core + proprietary enterprise/ | ||
| promptfoo | Ops & evals Evals & red teaming | Open core | MIT | ||
| Dify | Workflow automation LLM app platform | Open core | Dify Open Source License | ||
| n8n | Workflow automation Visual workflows | Open core | Sustainable Use License |
“Works with” lists only integrations named in the tool’s official README or docs; a missing pill means not yet confirmed, not unsupported. No listing is paid for. If we ever sell a sponsored slot it will be labelled, kept out of the ranked list and flagged in the data. For agents: /tools.md, /api/v1/tools.json, new this month. Logos are trademarks of their owners, shown in one colour to identify each tool.