3612+ open-source llm plugin tools ranked by stars
LLM Plugin tools are open-source packages that extend AI coding agents like Claude Code, OpenAI Codex, Gemini CLI, and other AI assistants. They provide specialized capabilities ranging from code generation and debugging to API integration and workflow automation.
Agent Skills Hub indexes 3612+ llm plugin tools from GitHub, ranked by community adoption (stars), code quality scores, and compatibility with popular AI agents. The top languages in this category are TypeScript, Python, Rust, Swift, Zig.
| # | Skill | Stars | Lang |
|---|---|---|---|
| 1 | promptfoo Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare p |
★ 25.9k | TypeScript |
| 2 | needle Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction |
★ 13.8k | Python |
| 3 | gorilla Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls) |
★ 13.0k | Python |
| 4 | PocketFlow-Tutorial-Codebase-Knowledge Pocket Flow: Codebase to Tutorial |
★ 12.7k | Python |
| 5 | llm Access large language models from the command-line |
★ 12.6k | Python |
| 6 | phoenix AI Observability & Evaluation |
★ 11.8k | Python |
| 7 | llm-engineer-toolkit A curated list of 120+ LLM libraries category wise. |
★ 10.9k | |
| 8 | code2prompt A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, an |
★ 7.7k | Rust |
| 9 | DeepAudit DeepAudit：人人拥有的 AI 黑客战队，让漏洞挖掘触手可及。国内首个开源的代码漏洞挖掘多智能体系统。小白一键部署运行，自主协作审计 + 自动化沙箱 PoC 验证。支持 Ollama 私有部署 |
★ 7.1k | Python |
| 10 | superagent Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. |
★ 6.7k | TypeScript |
| 11 | ai-cookbook Examples and tutorials to help developers build AI systems |
★ 4.6k | Python |
| 12 | DecryptPrompt 总结Prompt&LLM论文，开源数据&模型，AIGC应用 |
★ 3.4k | |
| 13 | ax The pretty much "official" DSPy framework for Typescript |
★ 3.0k | TypeScript |
| 14 | awesome-local-llm A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally |
★ 3.0k | |
| 15 | yek A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumptio |
★ 2.5k | Rust |
| 16 | code-interpreter Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app |
★ 2.4k | Python |
| 17 | WritingTools The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writi |
★ 2.4k | Swift |
| 18 | awesome-jev A curated list of public projects, integrations, and discussions built on Jev — TypeSafe AI's System |
★ 2.3k | Python |
| 19 | any-llm Communicate with an LLM provider using a single interface |
★ 2.2k | Python |
| 20 | tau2-bench τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains |
★ 2.2k | Python |
| 21 | obsidian-textgenerator-plugin Text Generator is a versatile plugin for Obsidian that allows you to generate text content using var |
★ 2.0k | TypeScript |
| 22 | repo2txt Web-based tool converts GitHub repository contents into a single formatted text file |
★ 1.8k | TypeScript |
| 23 | BruteForceAI Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks |
★ 1.7k | Python |
| 24 | awesome-llm-agents A curated list of awesome LLM agents frameworks. |
★ 1.6k | Python |
| 25 | ExtractThinker ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexi |
★ 1.6k | Python |
| 26 | mirascope The LLM Anti-Framework |
★ 1.5k | Python |
| 27 | desktop E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to |
★ 1.5k | Python |
| 28 | spacy-llm 🦙 Integrating LLMs into structured NLP pipelines |
★ 1.4k | Python |
| 29 | TensorFold LLM Inference Engine for Metal, CUDA and Vulkan. |
★ 1.3k | Zig |
| 30 | langtrace Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applicat |
★ 1.2k | TypeScript |
| 31 | AnyJev Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (con |
★ 1.2k | Python |
| 32 | LLM-ToolMaker |
★ 1.1k | Jupyter Notebook |
| 33 | ontogpt LLM-based ontological extraction tools, including SPIRES |
★ 1.0k | Jupyter Notebook |
| 34 | NyaProxy NyaProxy acts like a smart, central manager for accessing various online services (APIs) – think AI |
★ 976 | Python |
| 35 | TypeLLM TypeLLM: LLMs with type-safe generation |
★ 944 | Python |
| 36 | code2prompt Code2Prompt is a powerful command-line tool that simplifies the process of providing context to Larg |
★ 882 | Python |
| 37 | obsidian-llm-wiki-local Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concepts → your Obsid |
★ 834 | Python |
| 38 | jev-chat-windows JevChat-Windows：聊天窗口旁挂的回复辅助。窗口截图 + 本地离线 OCR 读对方消息 → Jev 判断意图 → 3 条候选一键填入，发送永远手动 |
★ 796 | Python |
| 39 | awesome-jev-tools A curated list of tools built for Jev — TypeSafe AI's System One model for typed decisions. |
★ 750 | |
| 40 | kani kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 202 |
★ 607 | Python |
| 41 | tessera From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels |
★ 579 | Python |
| 42 | Atria-Dawn-Preview |
★ 567 | |
| 43 | echo The User Pays AI SDK |
★ 542 | TypeScript |
| 44 | otari Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with vi |
★ 518 | Python |
| 45 | vllm-cli A command-line interface tool for serving LLM using vLLM. |
★ 505 | Python |
| 46 | awesome-jev-gallery 🔥🔥 Awesome Jev: open-source models, projects, benchmarks, and independent evaluations for Jev and |
★ 504 | JavaScript |
| 47 | LLM-Tool-Survey This is the repository for the Tool Learning survey. |
★ 489 | |
| 48 | jev-chat-jarvis-mac 聊天悬浮窗助手（macOS）：屏幕感知 + 本地小模型判断意图与风险，按话术生成回复候选。纯只读。 |
★ 483 | Python |
| 49 | ToolNeuron On-device AI for Android — LLM chat (GGUF/llama.cpp), vision models (VLM), image generation (Stable |
★ 473 | Kotlin |
| 50 | JevRev An LLM + Jev workflow that changes EVERYTHING. Boost your vertebrate brain with a spine inside. |
★ 446 | TypeScript |
| 51 | LLM2Jev Turn local language models into Jev-style structured decision models. Get results from text and imag |
★ 435 | Python |
| 52 | OpenRCA [ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures? |
★ 431 | Python |
| 53 | neuroarxiv A skill to kill from-scratch coding — Claude checks real arXiv prior art before it designs a new arc |
★ 423 | TypeScript |
| 54 | predikit pypi-predikit: Turn any sklearn/XGBoost model into an LLM-callable tool. Framework-agnostic |
★ 417 | Python |
| 55 | chatgpt-subtitle-translator Token efficient translation tool based on ChatGPT or any OpenAI compatible LLM chat completion API |
★ 390 | JavaScript |
| 56 | claude-code-trace Claude Code session log viewer for JSONL files in ~/.claude/projects. Browse conversations, tool cal |
★ 376 | Rust |
| 57 | genai-code-review GitHub Action that reviews pull request diffs with an LLM and posts the comments on the PR |
★ 371 | Python |
| 58 | create-llm The fastest way to build and start training your own LLM. CLI tool that scaffolds production-ready P |
★ 362 | TypeScript |
| 59 | toolkit.dev Get paid to build LLM tools |
★ 357 | TypeScript |
| 60 | openjev-sglang Jev-compatible API endpoint based on open models (prefill-only) |
★ 333 | Python |
| 61 | llms-tools A list of LLMs Tools & Projects |
★ 327 | |
| 62 | leanctx Drop-in prompt compression for production LLM apps. Cut your token bill 40-60% without changing your |
★ 317 | Python |
| 63 | openai-function-calling-tools 🛠 openai function calling tools for JS/TS |
★ 313 | TypeScript |
| 64 | input0 Input0 — A macOS voice input tool: hold a hotkey to record, release to transcribe locally via STT, r |
★ 293 | Rust |
| 65 | apicat An efficient API documentation management tool that fully adheres to the OpenAPI specification and i |
★ 289 | Go |
| 66 | bocoel Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) tha |
★ 289 | Python |
| 67 | SecGPT A Test Project for a Network Security-oriented LLM Tool Emulating AutoGPT |
★ 287 | Python |
| 68 | ResumeForge 简历通 ResumeForge —— 本地优先的 AI 简历工作台：岗位管理、事实台账防虚构、AI 定制/手写简历、多格式导出、模拟面试与面试深挖、自动投递台、求职进度与数据看板。FastAPI + |
★ 272 | Python |
| 69 | resume-job-matcher TypeScript CLI for AI resume screening: hard constraints gate candidates out before scoring, every s |
★ 268 | TypeScript |
| 70 | codinit-dev Local-First Open Source web & mobile AI app builder — install on MacOS, Windows & Linux |
★ 266 | TypeScript |
| 71 | synto More than just Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concep |
★ 261 | Python |
| 72 | jev4pg Established strong JEV based natural language to SQL performance and well-covered semantic operators |
★ 258 | Python |
| 73 | gpt_server gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。 |
★ 253 | Python |
| 74 | marginalia A library-science-inspired personal knowledge management system with LLM agents |
★ 247 | Python |
| 75 | GermanWordEmbeddings Toolkit to obtain and preprocess German text corpora, train models and evaluate them with generated |
★ 245 | Jupyter Notebook |
| 76 | github-pr-summary Use LLM to summarize & review GitHub Pull Requests |
★ 230 | Rust |
| 77 | J-Wash Jacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian |
★ 228 | Python |
| 78 | llm-rl-environments-lil-course 🌱 A little course on Reinforcement Learning Environments for evaluating and training Language Model |
★ 218 | Python |
| 79 | cognidb CogniDB is a Python-powered Natural Language to SQL interface that enables users to query databases |
★ 216 | Python |
| 80 | frugon Free, local, open-source LLM cost analyzer - see where your LLM bill leaks, on your machine. |
★ 215 | Python |
| 81 | llm_intents Exposes internet search tools for use by LLM-backed Assist in Home Assistant |
★ 211 | Python |
| 82 | Eridanus 基于 OneBot 协议的多功能bot兼开发框架。以llm function calling为核心构建了更智能的功能调用机制。支持不接入QQ纯Live2d桌宠模式 |
★ 207 | Python |
| 83 | Awesome-Multi-Token-Prediction A curated list of papers, tools, and resources on Multi-Token Prediction (MTP) and related technique |
★ 205 | |
| 84 | cai User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results! |
★ 203 | Rust |
| 85 | runtime Deterministic skills-based browser agent |
★ 203 | TypeScript |
| 86 | cave-agent Stateful runtime management for LLM agents—inject, manipulate, and retrieve Python objects across tu |
★ 199 | Python |
| 87 | aitools_client Seth's AI Tools: A Unity based front end that uses ComfyUI and LLMs to create stories, images, movie |
★ 188 | C# |
| 88 | LLM-Tools Open-source calculator for LLM system requirements. |
★ 183 | Python |
| 89 | bpmn-assistant LLM-powered assistant for creating, editing, and interpreting business process diagrams |
★ 166 | Python |
| 90 | chatlab ⚡️🧪 Fast LLM Tool Calling Experimentation, big and smol |
★ 163 | Jupyter Notebook |
| 91 | OneJev 🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about s |
★ 163 | Python |
| 92 | garycli AI-native embedded engineering agent — from natural-language requirements to code, build, flash, run |
★ 154 | Python |
| 93 | lm-proxy OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, |
★ 150 | Python |
| 94 | llm-atomic-wiki An extension of Karpathy's LLM Wiki pattern: atom layer, topic-branches, two-layer Lint. Distilled f |
★ 149 | Shell |
| 95 | OpenWebui-Tools Custom tools to enhance your Open-Webui Experience! 🚀 |
★ 148 | Python |
| 96 | humanizer-local-model Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts |
★ 146 | Python |
| 97 | OSA Tool that just makes your open source project better using LLM agents |
★ 145 | Python |
| 98 | tokuin CLI tool – estimates LLM tokens/costs and runs provider-aware load tests for OpenAI, Anthropic, Open |
★ 144 | Rust |
| 99 | MLLM-Tool MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning |
★ 142 | Python |
| 100 | Voconly 本地优先 AI 语音输入工具 | Local-first AI voice typing tool. 支持 Whisper/SenseVoice/Parakeet/Qwen asr，离线可用，LLM |
★ 142 | C++ |