SwarmLLM: Free, open-source app that runs AI chat models on your own computer

by enapt · MCP Server · ★ 61

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install SwarmLLM

docker run -p 8800:8800 -v swarmllm-data:/data ghcr.io/enapt/swarmllm:latest
docker run --gpus all -p 8800:8800 -v swarmllm-data:/data ghcr.io/enapt/swarmllm:latest-cuda

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 68/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

aianthropic-apicandlechatgpt-alternativeclaude-codedecentralizeddistributed-inferenceggufhuggingfaceinference

Quick Facts

Stars61
Forks11
LanguageRust
CategoryMCP Server
LicenseApache-2.0
Quality Score68/100
Open Issues2
Last Updated2026-10-22
Created2026-02-24
Platformsclaude-code, mcp, rust
Est. Tokens~32k

About SwarmLLM

SwarmLLM A peer-to-peer LLM inference network in a single Rust binary. Pool hardware with other nodes to run 70B+ parameter models on machines that couldn't host them alone — no API tokens, no cloud fees, and encrypted traffic between every peer. Join the swarm. Run AI together — for free. Status — alpha, actively developed. Distributed inference is stable across multi-node deployments.

Compatible Skills

These tools work well together with SwarmLLM for enhanced workflows:

  • anthropic-proxy-rs — semantic(0.22)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (66%)
  • claude-code-api-rs — semantic(0.22)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (66%)
  • token_proxy — semantic(0.18)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (64%)

SwarmLLM alternative? Top 6 similar tools

Looking for a SwarmLLM alternative? If you're comparing SwarmLLM with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • localmind by abdulmominsakib · ⭐ 288

    A mobile application designed to provide a beautiful, fast, and privacy-respecting interface for on device LLM

  • LumaBrowser by amurgola · ⭐ 124

    Local AI desktop app: a Chromium browser with a GPU-aware llama.cpp runtime, OpenAI-compatible API, AI chat an

  • ovo-local-llm by ovoment · ⭐ 105

    A private Claude-Code-style coding agent for Apple Silicon — run chat, code, and local model workflows on-devi

  • open-jet by L-Forster · ⭐ 92

    An offline coding agent for local models. One command sets up the best model your GPU can run, and on 24 GB+ R

  • flock by hadihonarvar · ⭐ 56

    Self-hosted LLM gateway. One Go binary turns your Macs and Linux boxes into a private inference cluster — mult

  • ENZO by theguysudo · ⭐ 115

    Self-hosted AI workspace with agents, skills, and tools (Gmail, Calendar) that runs entirely on your own provi

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Rust Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools