Rapid-MLX: Open-source OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused

by raullenchai · MCP Server · ★ 4.2k

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install Rapid-MLX

brew install raullenchai/rapid-mlx/rapid-mlx
pip install rapid-mlx

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 69/100

None of the 44 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

anthropic-apiapple-siliconclaude-codecoding-agentscontinuous-batchinginference-serverllm-inferencellm-serverlm-studio-alternativelocal-ai

Quick Facts

Stars4,163
Forks446
LanguagePython
CategoryMCP Server
LicenseApache-2.0
Quality Score69/100
Open Issues14
Last Updated2026-11-19
Created2026-02-25
Platformsclaude-code, mcp, python
Est. Tokens~22k

About Rapid-MLX

Rapid-MLX Run AI on your Mac. Faster than anything else. Run local AI models on your Mac — no cloud, no API costs. Works with Cursor, Claude Code, and any OpenAI-compatible app. pip install → serve Gemma 4 26B → chat + tool calling → works with PydanticAI, LangChain, Aider, and more. Speed (

Compatible Skills

These tools work well together with Rapid-MLX for enhanced workflows:

  • vllm-mlx — semantic(0.38)+complementary+shared_fw(openai)+rare_topics+same_lang+similar_pop+shared_platform (85%)
  • ovo-local-llm — semantic(0.48)+complementary+shared_fw(ollama,openai)+rare_topics+shared_platform (71%)
  • mlx-omni-server — semantic(0.37)+complementary+shared_fw(openai)+rare_topics+same_lang+similar_pop+shared_platform (71%)
  • openyak — semantic(0.20)+complementary+shared_fw(ollama,openai)+same_lang+similar_pop+shared_platform (68%)
  • mlx-serve — semantic(0.54)+complementary+shared_fw(openai)+rare_topics+shared_platform (65%)

Rapid-MLX alternative? Top 6 similar tools

Looking for a Rapid-MLX alternative? If you're comparing Rapid-MLX with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • vllm-mlx by waybarrios · ⭐ 1.6k

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuou

  • MTPLX by youssofal · ⭐ 2.7k

    The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenC

  • mlx-serve by ddalcu · ⭐ 2.5k

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swif

  • claude-code-local by nicedreamzapp · ⭐ 3.5k

    Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4

  • bifrost by maximhq · ⭐ 9.8k

    Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One Op

  • ai-devkit by codeaholicguy · ⭐ 1.7k

    The control plane for AI coding agents.

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools