mlx-llm — Agent Tool by riccardomusmeci

by riccardomusmeci · Agent Tool · ★ 459

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

About mlx-llm

mlx-llm Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX. Go to the entire Youtube Video. How to install 🔨 Models 🧠 Currently, out-of-the-box supported models are: To create a model with pre-trained weights from HuggingFace: You can also load a new version of pre-trained weights for a

llamallmmistralmlxphitransformers

Quick Facts

Stars459
Forks28
LanguagePython
CategoryAgent Tool
Quality Score40.25/100
Last Updated2025-01-29
Created2023-12-07
Platformspython
Est. Tokens~127k

Compatible Skills

These tools work well together with mlx-llm for enhanced workflows:

  • vllm-mlx — semantic(0.36)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • universal-intelligence — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (60%)
  • BambooAI — semantic(0.15)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • coderunner — semantic(0.24)+complementary+same_lang+similar_pop+shared_platform (53%)
  • mxcp — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

mlx-llm alternative? Top 6 similar tools

Looking for a mlx-llm alternative? If you're comparing mlx-llm with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • ovo-local-llm by ovoment · ⭐ 95

    A private Claude-Code-style coding agent for Apple Silicon — run chat, code, and local model workflows on-devi

  • Risuai by kwaroran · ⭐ 1.5k

    Make your own story. User-friendly software for LLM roleplaying

  • WorkflowAI by WorkflowAI · ⭐ 470

    WorkflowAI is an open-source platform where product and engineering teams 
collaborate to build and iterate on

  • cai by ad-si · ⭐ 202

    User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

  • dialoqbase by n4ze3m · ⭐ 1.8k

    Create chatbots with ease

  • spacy-llm by explosion · ⭐ 1.4k

    🦙 Integrating LLMs into structured NLP pipelines

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is mlx-llm?

mlx-llm is Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.. It is categorized as a Agent Tool with 459 GitHub stars.

What programming language is mlx-llm written in?

mlx-llm is primarily written in Python. It covers topics such as llama, llm, mistral.

How do I install or use mlx-llm?

You can find installation instructions and usage details in the mlx-llm GitHub repository at github.com/riccardomusmeci/mlx-llm. The project has 459 stars and 28 forks, indicating an active community.

What are the best alternatives to mlx-llm?

The top alternatives to mlx-llm on Agent Skills Hub include ovo-local-llm, Risuai, WorkflowAI. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse Agent Tool tools