Run AI models locally with privacy and no API costs. Find the best tools for self-hosted LLM inference, fine-tuning, and deployment.
🎙️ AI Dictation App - Open Source and Local-first ⚡ Type 3x faster, no keyboard needed. 🆓 Powered by open source models, works offline, fast and accurate.
Never give AI companies your secrets! A local LLM-based privacy filter for LLM users. Seamless integration with your existing AI tools as a Python library / OpenAI SDK replacement / API Gatetway / Web Server.
A privacy-first, self-hosted, fully open source personal knowledge management software, written in typescript and golang.
Local Deep Research achieves ~95% on SimpleQA benchmark (tested with GPT-4.1-mini). Supports local and cloud LLMs (Ollama, Google, Anthropic, ...). Searches 10+ sources - arXiv, PubMed, web, and your private documents. Everything Local & Encrypted.
Open-source LLM router & AI cost optimizer. Routes simple prompts to cheap/local models, complex ones to premium — automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor, OpenClaw. Saves 40-70% on AI API costs. Self-hosted, no middleman.
🤖 Visual AI agent workflow automation platform with local LLM integration - build intelligent workflows using drag-and-drop interface, no cloud dependencies required.
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, kimi,doubao. Adapted to local llms, vlm, gguf such as llama-3.3 Janus-Pro, Linkage graphRAG
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference
| Tool | Stars | Language | License | Score |
|---|---|---|---|---|
| amical | ★ 1.0k | TypeScript | MIT | 38 |
| promptmask | ★ 86 | Python | MIT | 38 |
| siyuan | ★ 42.2k | TypeScript | AGPL-3.0 | 50 |
| local-deep-research | ★ 4.2k | Python | MIT | 39 |
| NadirClaw | ★ 336 | Python | MIT | 47 |
| agentic-signal | ★ 142 | TypeScript | — | 37 |
| maid | ★ 2.4k | TypeScript | MIT | 39 |
| comfyui_LLM_party | ★ 2.1k | Python | AGPL-3.0 | 38 |
| LocalAI | ★ 44.2k | Go | MIT | 53 |
| open-webui | ★ 128.9k | Python | — | 57 |
The top local llm tools tools include amical, promptmask, siyuan. These are ranked by our composite score based on GitHub stars, community activity, and code quality.
Most tools listed here are open-source. 8 out of 10 have explicit open-source licenses, making them free to use and modify.
Consider your tech stack (language compatibility), project scale (stars indicate community trust), and specific features you need. Use the comparison table above to evaluate side by side.
Top 20 fastest-growing AI tools delivered every Monday. Free.
No spam, unsubscribe anytime.