mlx-omni-server: Local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon chips

by madroidmaq · Agent Tool · ★ 745

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install mlx-omni-server

pip install mlx-omni-server
git clone https://github.com/madroidmaq/mlx-omni-server.git

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 68/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

function-callinggenaimlxopenaiopenai-apistructured-outputstttoolstts

Quick Facts

Stars745
Forks90
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score68/100
Open Issues25
Last Updated2026-05-09
Created2024-11-05
Platformscli, python
Est. Tokens~371k

About mlx-omni-server

MLX Omni Server Local AI inference server optimized for Apple Silicon MLX Omni Server provides dual API compatibility with both OpenAI and Anthropic APIs, enabling seamless local inference on Apple Silicon using the MLX framework.

Compatible Skills

These tools work well together with mlx-omni-server for enhanced workflows:

  • vllm-mlx — semantic(0.33)+complementary+shared_fw(openai)+rare_topics+same_lang+similar_pop+shared_platform (78%)
  • MCP-Bridge — semantic(0.20)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (60%)
  • open-responses-server — semantic(0.17)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (59%)
  • coderunner — semantic(0.20)+complementary+same_lang+similar_pop+shared_platform (52%)

mlx-omni-server alternative? Top 6 similar tools

Looking for a mlx-omni-server alternative? If you're comparing mlx-omni-server with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • openai-function-calling-tools by JohannLai · ⭐ 313

    🛠 openai function calling tools for JS/TS

  • vllm-mlx by waybarrios · ⭐ 1.6k

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuou

  • sgr-agent-core by vamplabAI · ⭐ 1.1k

    Schema-Guided Reasoning (SGR) has agentic system design created by neuraldeep community

  • AI-Gateway by Azure-Samples · ⭐ 1.0k

    Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Mic

  • openai-assistant-swarm by Mintplex-Labs · ⭐ 616

    Introducing the Assistant Swarm. An extension to the OpenAI Node SDK to automatically delegate work to any ass

  • gpt_server by shell-nlp · ⭐ 253

    gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools