litellm — MCP Server by BerriAI

by BerriAI · MCP Server · ★ 50.7k

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

About litellm

🚅 LiteLLM Call 100+ LLMs in OpenAI format. [Bedrock, Azure, OpenAI, VertexAI, Anthropic, Groq, etc.] LiteLLM Proxy Server (AI Gateway) Enterprise Tier </

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmops

Quick Facts

Stars50,723
Forks8,967
LanguagePython
CategoryMCP Server
Quality Score48.092/100
Open Issues3390
Last Updated2026-06-18
Created2023-07-27
Platformsmcp, python
Est. Tokens~19k

litellm alternative? Top 6 similar tools

Looking for a litellm alternative? If you're comparing litellm with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • gateway by Portkey-AI · ⭐ 11.8k

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & fr

  • 9router by decolua · ⭐ 17.8k

    Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/G

  • langchain by langchain-ai · ⭐ 139.6k

    The agent engineering platform.

  • headroom by chopratejas · ⭐ 31.6k

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answer

  • unity-mcp by CoplayDev · ⭐ 10.7k

    Unity MCP acts as a bridge between AI assistants and your Unity Editor. Give your LLM tools to manage assets,

  • open-webui by open-webui · ⭐ 141.9k

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

Frequently Asked Questions

What is litellm?

litellm is Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropi. It is categorized as a MCP Server with 50.7k GitHub stars.

What programming language is litellm written in?

litellm is primarily written in Python. It covers topics such as ai-gateway, anthropic, azure-openai.

How do I install or use litellm?

You can find installation instructions and usage details in the litellm GitHub repository at github.com/BerriAI/litellm. The project has 50.7k stars and 8967 forks, indicating an active community.

What are the best alternatives to litellm?

The top alternatives to litellm on Agent Skills Hub include gateway, 9router, langchain. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse MCP Server tools