No red flags found in any of the 11 categories — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →
by zetaalphavector · Agent Tool · ★ 131
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
🔒 Is RAGElo safe to install? View the security audit →
Elo-based RAG Agent evaluator RAGElo[^1] is a streamlined toolkit for evaluating Retrieval Augmented Generation (RAG)-powered Large Language Models (LLMs) question answering agents using the Elo rating system. While it has become easier to prototype and incorporate generative LLMs in production, evaluation is still the most challenging part of the solution. Comparing different outputs from multiple prompt and pipeline variations to a "gold standard" is not easy. Still, we can ask a powerful LLM to judge between pairs of answers and a set of questions. This led us to develop a simple tool for tournament-style Elo ranking of LLM outputs. By comparing answers from different RAG pipelines and prompts over multiple questions, RAGElo computes a ranking of the different settings, providing a good overview of what works (and what doesn't). ⚙️ Installation For using RAGElo as a Python library or as CLI, install it using pip: When working from source we recommend an isolated environment (e.g., ). The project's Python lives at . Environment variables and providers: OpenAI requires . Set it in your shell or load it via dotenv before invoking the CLI. Ollama is
| Stars | 131 |
| Forks | 7 |
| Language | Python |
| Category | Agent Tool |
| License | Apache-2.0 |
| Quality Score | 59.7501736526283/100 |
| Open Issues | 5 |
| Last Updated | 2026-09-21 |
| Created | 2023-10-10 |
| Platforms | python |
| Est. Tokens | ~19k |
Looking for a RAGElo alternative? If you're comparing RAGElo with other agent tool tools, these 3 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
Lightweight registry to discover, install, and manage all public Claude plugins and agent skills for your favo
A Claude Code skill that turns PDFs, docs, and codebases into Obsidian study vaults
Power rename/refactor tool for CLI and agent use
Explore other popular agent tool tools:
RAGElo is RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker. It is categorized as a Agent Tool with 131 GitHub stars.
RAGElo is primarily written in Python.
You can find installation instructions and usage details in the RAGElo GitHub repository at github.com/zetaalphavector/RAGElo. The project has 131 stars and 7 forks, indicating an active community.
RAGElo is released under the Apache-2.0 license, making it free to use and modify according to the license terms.
The top alternatives to RAGElo on Agent Skills Hub include claude-plugins, tutor-skills, repren. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.
Grades come from a rule-based scan built on the SlowMist agent-security taxonomy, covering 11 red-flag categories including credential harvesting, data exfiltration, and curl | sh installers. It is a first-layer scan, not a manual audit — we say so rather than overstate it.
The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.
Sources & who's responsible: