mlx-serve: Native LLM inference server for Apple Silicon

by ddalcu · Agent Tool · ★ 2.4k

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install mlx-serve

brew install mlx-serve          # CLI server only

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 71/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

agentanthropic-apiapple-siliconclaude-codedeepseek-v4diffusionggufimage-generationinferencellm

Quick Facts

Stars2,391
Forks252
LanguageZig
CategoryAgent Tool
Quality Score71/100
Open Issues87
Last Updated2026-11-07
Created2026-02-17
Platformsclaude-code
Est. Tokens~23k

About mlx-serve

mlx-serve — run any LLM on your Mac OpenAI- and Anthropic-compatible local inference for Apple Silicon — MLX and GGUF — faster than LM Studio on the same file. No Python. No cloud. No Electron. ddalcu.github.io/mlx-serve · Download MLX Core.app · Changelog ★ If mlx-serve saves you from spinning up another Electron app, star the repo — it genuinely helps people fin

mlx-serve alternative? Top 6 similar tools

Looking for a mlx-serve alternative? If you're comparing mlx-serve with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • vllm-mlx by waybarrios · ⭐ 1.6k

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuou

  • claude-code-local by nicedreamzapp · ⭐ 3.5k

    Hit your Claude Code usage limit? Keep going free and offline on a local model. Claude Code Local runs on Appl

  • axonhub by looplj · ⭐ 5.4k

    ⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & e

  • vmlx by jjang-ai · ⭐ 911

    vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm

  • ARIS-in-AI-Offer by wanshuiyin · ⭐ 641

    Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview

  • cursor-talk-to-figma-mcp by grab · ⭐ 7.1k

    TalkToFigma: MCP integration between AI Agent (Cursor, Claude Code, Codex) and Figma, allowing Agentic AI to c

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Zig Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools