by agentscope-ai · Agent Tool · ★ 1.0k
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
pip install py-openjudgeTaken from the project's README on GitHub. Check the security audit before running it.
None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →
The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.
| Stars | 1,039 |
| Forks | 99 |
| Language | Python |
| Category | Agent Tool |
| License | Apache-2.0 |
| Quality Score | 60/100 |
| Open Issues | 13 |
| Last Updated | 2026-11-03 |
| Created | 2025-07-08 |
| Platforms | python |
| Est. Tokens | ~18k |
Holistic Evaluation, Quality Rewards: Driving Application Excellence 🌟 If you find OpenJudge helpful, please give us a Star! 🌟 🌐 Website 中文 OpenJudge is an open-source evaluation framework for AI applications (e.g., AI agents or chatbots) designed to evaluate quality and drive continuous application optimization.
Looking for a OpenJudge alternative? If you're comparing OpenJudge with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, eva
Shell and coding agent on mcp clients
OpenClaw-inspired autonomous AI agent built entirely in n8n. Adaptive RAG-powered memory, Skills via MCP templ
Aser is a lightweight, self-assembling AI Agent frame.
The missing linter and lsp for AI coding assistants. Validate CLAUDE.md, AGENTS.md, SKILL.md, hooks, MCP. Plug
Bring Agent Skills to Any AI Agent and Coding Agent — via CLI or MCP. Manage once, serve anywhere.
Explore other popular agent tool tools:
Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.
The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.
Sources & who's responsible: