mlx-serve — Agent Tool by ddalcu

by ddalcu · Agent Tool · ★ 551

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

🔒 Is mlx-serve safe to install? View the security audit →

About mlx-serve

mlx-serve — run any LLM on your Mac OpenAI- and Anthropic-compatible local inference for Apple Silicon — MLX and GGUF — faster than LM Studio on the same file. No Python. No cloud. No Electron. ddalcu.github.io/mlx-serve · Download MLX Core.app · Changelog ★ If mlx-serve saves you from spinning up another Electron app, star the repo — it genuinely helps people fin

agentanthropic-apiapple-siliconclaude-codedeepseek-v4diffusionggufimage-generationinferencellm

Quick Facts

Stars551
Forks39
LanguageZig
CategoryAgent Tool
Quality Score71.1837400706557/100
Open Issues16
Last Updated2026-08-09
Created2026-02-17
Platformsclaude-code
Est. Tokens~23k

mlx-serve alternative? Top 6 similar tools

Looking for a mlx-serve alternative? If you're comparing mlx-serve with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • vllm-mlx by waybarrios · ⭐ 1.5k

    OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL,

  • maclocal-api by scouzi1966 · ⭐ 324

    'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and othe

  • SAM by SyntheticAutonomicMind · ⭐ 131

    Synthetic Autonomic Mind - An AI assistant for everyone.

  • vmlx by jjang-ai · ⭐ 794

    vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hyb

  • ARIS-in-AI-Offer by wanshuiyin · ⭐ 338

    Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview

  • Toolio by OoriData · ⭐ 132

    GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Zig Agent Tools

Frequently Asked Questions

What is mlx-serve?

mlx-serve is Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.. It is categorized as a Agent Tool with 551 GitHub stars.

What programming language is mlx-serve written in?

mlx-serve is primarily written in Zig. It covers topics such as agent, anthropic-api, apple-silicon.

How do I install or use mlx-serve?

You can find installation instructions and usage details in the mlx-serve GitHub repository at github.com/ddalcu/mlx-serve. The project has 551 stars and 39 forks, indicating an active community.

What are the best alternatives to mlx-serve?

The top alternatives to mlx-serve on Agent Skills Hub include vllm-mlx, maclocal-api, SAM. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse Agent Tool tools