# LiteLLM

> AI gateway and SDK that puts 100+ LLM APIs, including local servers, behind one OpenAI-format endpoint.

Canonical: https://thelocalbench.com/tools/litellm · Data as of 2026-10-12 · The Local Bench (thelocalbench.com), data as of 2026-10-12, CC BY 4.0

Flags: [verified] checked against primary source · [sourced] cited · [estimate] formula · [sample] placeholder

- Category: Ops & evals / Gateway
- Website: https://docs.litellm.ai/docs/
- Repository: https://github.com/BerriAI/litellm
- Open source: yes, MIT core + proprietary enterprise/ [verified] https://github.com/BerriAI/litellm/blob/HEAD/LICENSE
- Pricing: open-core, starting $0 [verified] https://github.com/BerriAI/litellm
- Platforms: Docker [sourced] https://github.com/BerriAI/litellm#readme
- Added 2026-10-13, last verified 2026-10-13
- Sponsored: no

## Works with local models

| Integration | Status | Flag | Source |
|---|---|---|---|
| Ollama | yes | [sourced] | https://github.com/BerriAI/litellm#readme |
| llama.cpp | not yet confirmed | [not_measured] |  |
| LM Studio | yes | [sourced] | https://github.com/BerriAI/litellm#readme |
| OpenAI-compatible | yes | [sourced] | https://github.com/BerriAI/litellm#readme |
| MCP | yes | [sourced] | https://github.com/BerriAI/litellm#readme |

JSON: https://thelocalbench.com/api/v1/tools/litellm.json

Logo: trademark of its owner, shown to identify the tool (source: favicon-svg, https://docs.litellm.ai/img/brand/litellm-favicon.svg).