litellm — MCP Server by BerriAI

by BerriAI · MCP Server · ★ 54.3k

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

🔒 Is litellm safe to install? View the security audit →

About litellm

🚅 LiteLLM Call 100+ LLMs in OpenAI format. [Bedrock, Azure, OpenAI, VertexAI, Anthropic, Groq, etc.] LiteLLM Proxy Server (AI Gateway) Enterprise Tier </

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmops

Quick Facts

Stars54,331
Forks9,962
LanguagePython
CategoryMCP Server
Quality Score63.6600777730429/100
Open Issues4118
Last Updated2026-07-22
Created2023-07-27
Platformsmcp, python
Est. Tokens~19k

litellm alternative? Top 6 similar tools

Looking for a litellm alternative? If you're comparing litellm with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • gateway by Portkey-AI · ⭐ 11.8k

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & fr

  • 9router by decolua · ⭐ 22.8k

    Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/G

  • OmniRoute by diegosouzapw · ⭐ 24.1k

    Never stop coding. Free MIT AI gateway: one endpoint, 268+ providers (50+ free), 500+ models — Kimi, Claude, G

  • langchain by langchain-ai · ⭐ 142.3k

    The agent engineering platform.

  • headroom by chopratejas · ⭐ 44.4k

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answer

  • oh-my-pi by can1357 · ⭐ 19.1k

    ⌥ AI Coding agent for the terminal — hash-anchored edits, optimized tool harness, LSP, Python, browser, subag

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

Frequently Asked Questions

What is litellm?

litellm is The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi. It is categorized as a MCP Server with 54.3k GitHub stars.

What programming language is litellm written in?

litellm is primarily written in Python. It covers topics such as ai-gateway, anthropic, azure-openai.

How do I install or use litellm?

You can find installation instructions and usage details in the litellm GitHub repository at github.com/BerriAI/litellm. The project has 54.3k stars and 9962 forks, indicating an active community.

What are the best alternatives to litellm?

The top alternatives to litellm on Agent Skills Hub include gateway, 9router, OmniRoute. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse MCP Server tools