vllm-mlx: High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon

by waybarrios · MCP Server · ★ 1.6k

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install vllm-mlx

uv tool install git+https://github.com/waybarrios/vllm-mlx.git
uv pip install git+https://github.com/waybarrios/vllm-mlx.git

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 71/100

None of the 43 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 43 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

anthropicanthropic-apiapple-siliconclaude-codecontinuous-batchinginference-serverllmlocal-llmmacosmcp

Quick Facts

Stars1,650
Forks237
LanguagePython
CategoryMCP Server
LicenseApache-2.0
Quality Score71/100
Open Issues108
Last Updated2026-11-05
Created2025-12-06
Platformsclaude-code, mcp, python
Est. Tokens~16k

About vllm-mlx

vLLM-MLX vLLM-like inference for Apple Silicon - GPU-accelerated Text, Image, Video & Audio on Mac Overview vllm-mlx brings native Apple Silicon GPU acceleration to vLLM by integrating: MLX: Apple's ML framework with unified memory and Metal kernels mlx-lm: Optimized LLM inference with KV cache and quantization mlx-vlm: Vision-language models for multimodal inference mlx-audio: Speech-to-Text and...

Compatible Skills

These tools work well together with vllm-mlx for enhanced workflows:

  • mlx-omni-server — semantic(0.33)+complementary+shared_fw(openai)+rare_topics+same_lang+similar_pop+shared_platform (78%)
  • Toolio — semantic(0.29)+complementary+rare_topics+same_lang+similar_pop+shared_platform (64%)
  • claude-stt — semantic(0.24)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • mlx-llm — semantic(0.36)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • PyVision — semantic(0.23)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)

vllm-mlx alternative? Top 6 similar tools

Looking for a vllm-mlx alternative? If you're comparing vllm-mlx with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • Rapid-MLX by raullenchai · ⭐ 4.1k

    Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silic

  • mlx-serve by ddalcu · ⭐ 2.4k

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swif

  • claude-code-local by nicedreamzapp · ⭐ 3.5k

    Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4

  • smg by lightseekorg · ⭐ 424

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpee

  • osaurus by osaurus-ai · ⭐ 8.2k

    Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cry

  • axonhub by looplj · ⭐ 5.4k

    ⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & e

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 43 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools