by promptfoo · LLM Plugin · ★ 23.4k
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
🔒 Is promptfoo safe to install? View the security audit →
Promptfoo: LLM evals & red teaming promptfoo is a CLI and library for evaluating and red-teaming LLM apps. Stop the trial-and-error approach - start shipping secure, reliable AI apps. Website · Getting Started · Red Teaming · Documentation · Discord Update (March 16, 2026): Promptfoo has joined OpenAI. Promptfoo remains open source and MIT licensed. Read the [company update](https://www.promptfoo.dev/
| Stars | 23,439 |
| Forks | 2,098 |
| Language | TypeScript |
| Category | LLM Plugin |
| License | MIT |
| Quality Score | 67.4141316700621/100 |
| Open Issues | 428 |
| Last Updated | 2026-07-20 |
| Created | 2023-04-28 |
| Platforms | claude-code, gemini, node |
| Est. Tokens | ~15k |
These tools work well together with promptfoo for enhanced workflows:
Looking for a promptfoo alternative? If you're comparing promptfoo with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
AI Observability & Evaluation
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answer
An AI prompt optimizer for writing better prompts and getting better AI results.
🚀💪Maximize your efficiency and productivity. The ultimate hub to manage, customize, and share prompts. (Engl
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation,
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with
Explore other popular llm plugin tools:
promptfoo is Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line . It is categorized as a LLM Plugin with 23.4k GitHub stars.
promptfoo is primarily written in TypeScript. It covers topics such as ci, ci-cd, cicd.
You can find installation instructions and usage details in the promptfoo GitHub repository at github.com/promptfoo/promptfoo. The project has 23.4k stars and 2098 forks, indicating an active community.
promptfoo is released under the MIT license, making it free to use and modify according to the license terms.
The top alternatives to promptfoo on Agent Skills Hub include phoenix, headroom, prompt-optimizer. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.