tokio-prompt-orchestrator: Tokio pipeline for serving LLM requests: bounded five-stage flow with dedup, circuit breakers, retries, rate

by Mattbusel · MCP Server · ★ 60

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install tokio-prompt-orchestrator

git clone https://github.com/Mattbusel/tokio-prompt-orchestrator

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 63/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

agentanthropicasyncbackpressurecircuit-breakerllmllm-servingmcpmodel-context-protocolmulti-agent

Quick Facts

Stars60
Forks4
LanguageRust
CategoryMCP Server
LicenseMIT
Quality Score63/100
Open Issues6
Last Updated2026-11-03
Created2025-10-07
Platformsmcp, rust
Est. Tokens~34k

About tokio-prompt-orchestrator

tokio-prompt-orchestrator Production-grade, multi-core Tokio orchestration for LLM inference pipelines. Five-stage bounded-backpressure DAG with deduplication, circuit breakers, rate limiting, prompt injection/jailbreak detection, provider arbitrage (cheapest provider meeting your latency SLA), adaptive worker pool sizing, and an optional autonomous self-improving control loop.

tokio-prompt-orchestrator alternative? Top 6 similar tools

Looking for a tokio-prompt-orchestrator alternative? If you're comparing tokio-prompt-orchestrator with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • captain-claw by kstevica · ⭐ 193

    Command a fleet of AI agents, on every deck, every desk, every wrist. Self-hosted multi-agent platform with me

  • llmix by sno-ai · ⭐ 132

    Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with

  • pydantic-ai-shields by vstorm-co · ⭐ 94

    Guardrail capabilities for Pydantic AI — cost tracking, prompt injection detection, PII filtering, secret reda

  • t3router by vibheksoni · ⭐ 75

    Rust library for t3.chat API - Programmatic access to Claude, GPT-4, Gemini, and 50+ AI models. Perfect for bu

  • rust-docs-mcp-server by Govcraft · ⭐ 300

    🦀 Prevents outdated Rust code suggestions from AI assistants. This MCP server fetches current crate docs, use

  • omnicoreagent by omnirexflora-labs · ⭐ 252

    An agent runtime for Python. Give your agent real work. Keep control: every action checked before it runs, eve

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Rust Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools