semantic-router: A programmable Mixture-of-Models router for heterogeneous LLM inference

by vllm-project · MCP Server · ★ 6.5k

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 74/100

None of the 44 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

ai-gatewaybert-classificationfine-tuninggolanghuggingface-candlehuggingface-transformerskubernetesllmllmroutermcp

Quick Facts

Stars6,458
Forks1,116
LanguageGo
CategoryMCP Server
LicenseApache-2.0
Quality Score74/100
Open Issues641
Last Updated2026-11-12
Created2025-08-26
Platformsgo, k8s, mcp
Est. Tokens~17k

About semantic-router

🎯 Playground 📖 Publications Latest News 🔥 [2026/02/27] White Paper Released: Signal Driven Decision Routing for Mixture-of-Modality Models [2026/02/02] New SOTA on RouterArena (ICLR 2026): best overall score, Rank #1 [2026/01/05] Iris v0.1 is Released: vLLM Semantic Router v0.1 Iris: The First Major Release [2

Compatible Skills

These tools work well together with semantic-router for enhanced workflows:

  • bifrost — semantic(0.19)+rare_topics+same_lang+similar_pop+shared_platform (46%)

semantic-router alternative? Top 6 similar tools

Looking for a semantic-router alternative? If you're comparing semantic-router with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • UltraRAG by OpenBMB · ⭐ 5.7k

    A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

  • gateway by Portkey-AI · ⭐ 13.4k

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & fr

  • code2prompt by mufeedvh · ⭐ 7.7k

    A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token co

  • AI-Infra-Guard by Tencent · ⭐ 7.5k

    A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Sca

  • Kiln by Kiln-AI · ⭐ 5.3k

    Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation,

  • PPTAgent by icip-cas · ⭐ 5.3k

    An Agentic Framework for Reflective PowerPoint Generation

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Go Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools