by Mattbusel · MCP Server · ★ 50
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
tokio-prompt-orchestrator Production-grade, multi-core Tokio orchestration for LLM inference pipelines. Five-stage bounded-backpressure DAG with deduplication, circuit breakers, rate limiting, prompt injection/jailbreak detection, provider arbitrage (cheapest provider meeting your latency SLA), adaptive worker pool sizing, and an optional autonomous self-improving control loop. Supports Anthropic, OpenAI, llama.cpp, vLLM, and any custom backend. Exposes REST, WebSocket, SSE, MCP (Claude Desktop), Prometheus metrics, and OpenTelemetry distributed tracing.
| Stars | 50 |
| Forks | 5 |
| Language | Rust |
| Category | MCP Server |
| License | MIT |
| Quality Score | 63.7379725213552/100 |
| Open Issues | 2 |
| Last Updated | 2026-03-23 |
| Created | 2025-10-07 |
| Platforms | mcp, rust |
| Est. Tokens | ~20012k |
Looking for a tokio-prompt-orchestrator alternative? If you're comparing tokio-prompt-orchestrator with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
Open Python agent harness for production AI apps: tools, MCP, memory, workspace, telemetry, subagents, backgro
MCP C++ SDK - Model Context Protocol implementation in CPP with enterprise-grade security, observability and c
🧠 Production-grade memory sidecar for AI agents — gbrain + Hindsight + 3-tier recall. Agent-agnostic, battle-
Open source AI coding platform with Web IDE, multi-agent system, 37+ tools, MCP protocol. MIT licensed.
AI agent with multi-agent orchestration, autonomous cognitive systems, and a full management dashboard
A curated list of tools, papers, and datasets for applying AI to cybersecurity tasks. This list primarily focu
Explore other popular mcp server tools:
tokio-prompt-orchestrator is Multi-core, Tokio-native orchestration for LLM pipelines.. It is categorized as a MCP Server with 50 GitHub stars.
tokio-prompt-orchestrator is primarily written in Rust. It covers topics such as agent, async, backpressure.
You can find installation instructions and usage details in the tokio-prompt-orchestrator GitHub repository at github.com/Mattbusel/tokio-prompt-orchestrator. The project has 50 stars and 5 forks, indicating an active community.
tokio-prompt-orchestrator is released under the MIT license, making it free to use and modify according to the license terms.
The top alternatives to tokio-prompt-orchestrator on Agent Skills Hub include omnicoreagent, gopher-mcp, hermes-memory-installer. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.