3413+ open-source llm plugin tools ranked by stars
LLM Plugin tools are open-source packages that extend AI coding agents like Claude Code, OpenAI Codex, Gemini CLI, and other AI assistants. They provide specialized capabilities ranging from code generation and debugging to API integration and workflow automation.
Agent Skills Hub indexes 3413+ llm plugin tools from GitHub, ranked by community adoption (stars), code quality scores, and compatibility with popular AI agents. The top languages in this category are TypeScript, Python, Rust, Swift, Jupyter Notebook.
| # | Skill | Stars | Lang |
|---|---|---|---|
| 1 | promptfoo Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare p |
★ 25.7k | TypeScript |
| 2 | gorilla Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls) |
★ 13.0k | Python |
| 3 | needle Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, structured extraction and |
★ 13.0k | Python |
| 4 | PocketFlow-Tutorial-Codebase-Knowledge Pocket Flow: Codebase to Tutorial |
★ 12.7k | Python |
| 5 | llm Access large language models from the command-line |
★ 12.6k | Python |
| 6 | phoenix AI Observability & Evaluation |
★ 11.7k | Python |
| 7 | llm-engineer-toolkit A curated list of 120+ LLM libraries category wise. |
★ 10.9k | |
| 8 | code2prompt A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, an |
★ 7.7k | Rust |
| 9 | superagent Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. |
★ 6.7k | TypeScript |
| 10 | ai-cookbook Examples and tutorials to help developers build AI systems |
★ 4.6k | Python |
| 11 | DecryptPrompt 总结Prompt&LLM论文，开源数据&模型，AIGC应用 |
★ 3.4k | |
| 12 | ax The pretty much "official" DSPy framework for Typescript |
★ 3.0k | TypeScript |
| 13 | awesome-local-llm A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally |
★ 2.9k | |
| 14 | yek A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumptio |
★ 2.5k | Rust |
| 15 | code-interpreter Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app |
★ 2.4k | Python |
| 16 | WritingTools The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writi |
★ 2.4k | Swift |
| 17 | any-llm Communicate with an LLM provider using a single interface |
★ 2.2k | Python |
| 18 | tau2-bench τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains |
★ 2.1k | Python |
| 19 | awesome-jev A curated list of public projects, integrations, and discussions built on Jev — TypeSafe AI's System |
★ 2.1k | Python |
| 20 | repo2txt Web-based tool converts GitHub repository contents into a single formatted text file |
★ 1.8k | TypeScript |
| 21 | BruteForceAI Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks |
★ 1.7k | Python |
| 22 | ExtractThinker ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexi |
★ 1.6k | Python |
| 23 | awesome-llm-agents A curated list of awesome LLM agents frameworks. |
★ 1.6k | Python |
| 24 | mirascope The LLM Anti-Framework |
★ 1.5k | Python |
| 25 | desktop E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to |
★ 1.5k | Python |
| 26 | spacy-llm 🦙 Integrating LLMs into structured NLP pipelines |
★ 1.4k | Python |
| 27 | langtrace Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applicat |
★ 1.2k | TypeScript |
| 28 | LLM-ToolMaker |
★ 1.1k | Jupyter Notebook |
| 29 | AnyJev Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (con |
★ 1.0k | Python |
| 30 | ontogpt LLM-based ontological extraction tools, including SPIRES |
★ 1.0k | Jupyter Notebook |
| 31 | NyaProxy NyaProxy acts like a smart, central manager for accessing various online services (APIs) – think AI |
★ 976 | Python |
| 32 | TensorFold Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint |
★ 944 | Python |
| 33 | TypeLLM TypeLLM: LLMs with type-safe generation |
★ 913 | Python |
| 34 | code2prompt Code2Prompt is a powerful command-line tool that simplifies the process of providing context to Larg |
★ 882 | Python |
| 35 | awesome-jev-tools A curated list of tools built for Jev — TypeSafe AI's System One model for typed decisions. |
★ 740 | |
| 36 | jev-chat-windows JevChat-Windows：聊天窗口旁挂的回复辅助。窗口截图 + 本地离线 OCR 读对方消息 → Jev 判断意图 → 3 条候选一键填入，发送永远手动 |
★ 728 | Python |
| 37 | JevRev An LLM + Jev workflow that changes EVERYTHING. Boost your vertebrate brain with a spine inside. |
★ 703 | TypeScript |
| 38 | kani kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 202 |
★ 607 | Python |
| 39 | tessera From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels |
★ 579 | Python |
| 40 | Atria-Dawn-Preview |
★ 567 | |
| 41 | echo The User Pays AI SDK |
★ 542 | TypeScript |
| 42 | vllm-cli A command-line interface tool for serving LLM using vLLM. |
★ 505 | Python |
| 43 | otari Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with vi |
★ 503 | Python |
| 44 | LLM-Tool-Survey This is the repository for the Tool Learning survey. |
★ 489 | |
| 45 | awesome-jev-gallery 🔥🔥 Awesome Jev: open-source models, projects, benchmarks, and independent evaluations for Jev and |
★ 488 | JavaScript |
| 46 | ToolNeuron On-device AI for Android — LLM chat (GGUF/llama.cpp), vision models (VLM), image generation (Stable |
★ 461 | Kotlin |
| 47 | jev-chat-jarvis-mac 聊天悬浮窗助手（macOS）：屏幕感知 + 本地小模型判断意图与风险，按话术生成回复候选。纯只读。 |
★ 453 | Python |
| 48 | neuroarxiv A skill to kill from-scratch coding — Claude checks real arXiv prior art before it designs a new arc |
★ 423 | TypeScript |
| 49 | predikit pypi-predikit: Turn any sklearn/XGBoost model into an LLM-callable tool. Framework-agnostic |
★ 417 | Python |
| 50 | OpenRCA [ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures? |
★ 401 | Python |
| 51 | chatgpt-subtitle-translator Token efficient translation tool based on ChatGPT or any OpenAI compatible LLM chat completion API |
★ 390 | JavaScript |
| 52 | LLM2Jev Turn local language models into Jev-style structured decision models. Get results from text and imag |
★ 387 | Python |
| 53 | claude-code-trace Claude Code session log viewer for JSONL files in ~/.claude/projects. Browse conversations, tool cal |
★ 374 | Rust |
| 54 | create-llm The fastest way to build and start training your own LLM. CLI tool that scaffolds production-ready P |
★ 362 | TypeScript |
| 55 | toolkit.dev Get paid to build LLM tools |
★ 357 | TypeScript |
| 56 | openjev-sglang Jev-compatible API endpoint based on open models (prefill-only) |
★ 337 | Python |
| 57 | llms-tools A list of LLMs Tools & Projects |
★ 327 | |
| 58 | leanctx Drop-in prompt compression for production LLM apps. Cut your token bill 40-60% without changing your |
★ 317 | Python |
| 59 | openai-function-calling-tools 🛠 openai function calling tools for JS/TS |
★ 310 | TypeScript |
| 60 | input0 Input0 — A macOS voice input tool: hold a hotkey to record, release to transcribe locally via STT, r |
★ 293 | Rust |
| 61 | apicat An efficient API documentation management tool that fully adheres to the OpenAPI specification and i |
★ 289 | Go |
| 62 | bocoel Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) tha |
★ 289 | Python |
| 63 | SecGPT A Test Project for a Network Security-oriented LLM Tool Emulating AutoGPT |
★ 286 | Python |
| 64 | resume-job-matcher TypeScript CLI for AI resume screening: hard constraints gate candidates out before scoring, every s |
★ 268 | TypeScript |
| 65 | codinit-dev Local-First Open Source web & mobile AI app builder — install on MacOS, Windows & Linux |
★ 266 | TypeScript |
| 66 | gpt_server gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。 |
★ 254 | Python |
| 67 | marginalia A library-science-inspired personal knowledge management system with LLM agents |
★ 247 | Python |
| 68 | J-Wash Jacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian |
★ 228 | Python |
| 69 | llm-rl-environments-lil-course 🌱 A little course on Reinforcement Learning Environments for evaluating and training Language Model |
★ 218 | Python |
| 70 | cognidb CogniDB is a Python-powered Natural Language to SQL interface that enables users to query databases |
★ 216 | Python |
| 71 | frugon Free, local, open-source LLM cost analyzer - see where your LLM bill leaks, on your machine. |
★ 212 | Python |
| 72 | ResumeForge 简历通 ResumeForge —— 本地优先的 AI 简历工作台：岗位管理、事实台账防虚构、AI 定制/手写简历、多格式导出、模拟面试与面试深挖、自动投递台、求职进度与数据看板。FastAPI + |
★ 208 | Python |
| 73 | llm_intents Exposes internet search tools for use by LLM-backed Assist in Home Assistant |
★ 207 | Python |
| 74 | Eridanus 基于 OneBot 协议的多功能bot兼开发框架。以llm function calling为核心构建了更智能的功能调用机制。支持不接入QQ纯Live2d桌宠模式 |
★ 206 | Python |
| 75 | Awesome-Multi-Token-Prediction A curated list of papers, tools, and resources on Multi-Token Prediction (MTP) and related technique |
★ 205 | |
| 76 | cai User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results! |
★ 202 | Rust |
| 77 | cave-agent Stateful runtime management for LLM agents—inject, manipulate, and retrieve Python objects across tu |
★ 199 | Python |
| 78 | aitools_client Seth's AI Tools: A Unity based front end that uses ComfyUI and LLMs to create stories, images, movie |
★ 188 | C# |
| 79 | LLM-Tools Open-source calculator for LLM system requirements. |
★ 183 | Python |
| 80 | bpmn-assistant LLM-powered assistant for creating, editing, and interpreting business process diagrams |
★ 166 | Python |
| 81 | chatlab ⚡️🧪 Fast LLM Tool Calling Experimentation, big and smol |
★ 163 | Jupyter Notebook |
| 82 | garycli AI-native embedded engineering agent — from natural-language requirements to code, build, flash, run |
★ 154 | Python |
| 83 | lm-proxy OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, |
★ 150 | Python |
| 84 | OSA Tool that just makes your open source project better using LLM agents |
★ 145 | Python |
| 85 | MLLM-Tool MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning |
★ 142 | Python |
| 86 | tokuin CLI tool – estimates LLM tokens/costs and runs provider-aware load tests for OpenAI, Anthropic, Open |
★ 142 | Rust |
| 87 | inferock-bench Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token |
★ 139 | TypeScript |
| 88 | aulite EU AI Act compliance proxy for AI systems. Drop-in HTTP proxy that monitors every AI interaction for |
★ 136 | TypeScript |
| 89 | OpenWebui-Tools Custom tools to enhance your Open-Webui Experience! 🚀 |
★ 135 | Python |
| 90 | multi-model-chat Multi-Model Chat — Compare responses from multiple AI models side by side in real-time. Supports GPT |
★ 134 | TypeScript |
| 91 | open-creator An open-source LLM tool for extracting repeatable tasks from your conversations, and saving them int |
★ 132 | Python |
| 92 | LLM_trader LLM-powered Crypto Trading Framework with Vision AI chart analysis, real-time Neural Engine, and a l |
★ 129 | Python |
| 93 | reality-engine Top Dynamic AI World Simulation & Storytelling Tools 2026 |
★ 129 | HTML |
| 94 | banks LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and cha |
★ 128 | Python |
| 95 | TokenTamer A drop-in proxy that compresses bloated code context in real-time, cutting LLM API costs by 50–80% w |
★ 127 | Python |
| 96 | cursive ✦ The intuitive LLM framework |
★ 119 | TypeScript |
| 97 | manim-generator Automatic LLM-based video generation using the manim library. Usage of a code-writer and code-review |
★ 117 | Python |
| 98 | reverse-engineering-is-over LLMs have ended reverse engineering as a high-barrier skill. Case study: reconstructing 6/7 custom H |
★ 116 | Python |
| 99 | AgentGuard AgentGuard：An Attribute-Based Access Control Framework for Tool-Use LLM-Based Agent |
★ 115 | Python |
| 100 | fastbrowse A fast browser agent: Jev picks each action from what is on the page, an LLM reads and plans, and ev |
★ 113 | Python |