litellm: The fastest, litest AI Gateway

by BerriAI · MCP Server · ★ 62.9k

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install litellm

pip install litellm
pip install 'litellm[proxy]'

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 64/100

Flagged: environment access. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmops

Quick Facts

Stars62,852
Forks13,081
LanguagePython
CategoryMCP Server
Quality Score64/100
Open Issues5706
Last Updated2026-11-07
Created2023-07-27
Platformsmcp, python
Est. Tokens~19k

About litellm

🚅 LiteLLM Call 100+ LLMs in OpenAI format. [Bedrock, Azure, OpenAI, VertexAI, Anthropic, Groq, etc.] LiteLLM Proxy Server (AI Gateway) Enterprise Tier </

litellm alternative? Top 6 similar tools

Looking for a litellm alternative? If you're comparing litellm with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • gateway by Portkey-AI · ⭐ 13.0k

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & fr

  • 9router by decolua · ⭐ 31.6k

    Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/G

  • langchain by langchain-ai · ⭐ 149.1k

    The agent engineering platform.

  • oh-my-pi by can1357 · ⭐ 38.1k

    ⌥ Coding agent with the IDE wired in. Built by Stencil Labs.

  • rtk by rtk-ai · ⭐ 85.7k

    CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero depend

  • opcode by winfunc · ⭐ 22.4k

    A powerful GUI app and Toolkit for Claude Code - Create custom agents, manage interactive Claude Code sessions

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools