Ops & evals · Gateway

LiteLLM

AI gateway and SDK that puts 100+ LLM APIs, including local servers, behind one OpenAI-format endpoint.

Facts

Website: docs.litellm.ai/docs
Repository: BerriAI/litellm
Open source: Yes, MIT core + proprietary enterprise/ Verified · Source
Pricing: Open core: Free to self-host · paid tiers Verified · Source
Platforms: Docker Sourced · Source
Added · checked: 2026-10-13 · 2026-10-13
Sponsored: No. Nobody paid for this listing or its position.

Works with local models

Ollama: Yes Sourced · Source
llama.cpp: Not yet confirmed Not yet measured
LM Studio: Yes Sourced · Source
OpenAI-compatible: Yes Sourced · Source
MCP: Yes Sourced · Source

Summary: Our one-line paraphrase of the official description. Source.
Logo: trademark of its owner, used only to identify LiteLLM. Source (favicon svg): https://docs.litellm.ai/img/brand/litellm-favicon.svg, checked 2026-10-13.
Machine-readable: Markdown · JSON