mlx-llm: Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX

by riccardomusmeci · Agent Tool · ★ 468

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install mlx-llm

pip install mlx-llm

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 63/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

llamallmmistralmlxphitransformers

Quick Facts

Stars468
Forks27
LanguagePython
CategoryAgent Tool
Quality Score63/100
Open Issues1
Last Updated2025-01-29
Created2023-12-07
Platformspython
Est. Tokens~127k

About mlx-llm

mlx-llm Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX. Go to the entire Youtube Video. How to install 🔨 Models 🧠 Currently, out-of-the-box supported models are: To create a model with pre-trained weights from HuggingFace: You can also load a new version of pre-trained weights for a

Compatible Skills

These tools work well together with mlx-llm for enhanced workflows:

  • vllm-mlx — semantic(0.36)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • universal-intelligence — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (60%)
  • BambooAI — semantic(0.15)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • coderunner — semantic(0.24)+complementary+same_lang+similar_pop+shared_platform (53%)
  • mxcp — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

mlx-llm alternative? Top 6 similar tools

Looking for a mlx-llm alternative? If you're comparing mlx-llm with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • ovo-local-llm by ovoment · ⭐ 105

    A private Claude-Code-style coding agent for Apple Silicon — run chat, code, and local model workflows on-devi

  • Risuai by kwaroran · ⭐ 1.8k

    Make your own story. User-friendly software for LLM roleplaying

  • WorkflowAI by WorkflowAI · ⭐ 467

    WorkflowAI is an open-source platform where product and engineering teams 
collaborate to build and iterate on

  • cai by ad-si · ⭐ 203

    User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

  • LLMCompiler by SqueezeAILab · ⭐ 1.9k

    [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

  • dialoqbase by n4ze3m · ⭐ 1.8k

    Create chatbots with ease

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools