OpenJudge — security grade SAFE, quality 60/100

Security audit verdict: SAFE · quality 60/100

No red flags found in any of the 11 categories — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

by agentscope-ai · Agent Tool · ★ 829

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

🔒 Is OpenJudge safe to install? View the security audit →

About OpenJudge

Holistic Evaluation, Quality Rewards: Driving Application Excellence 🌟 If you find OpenJudge helpful, please give us a Star! 🌟 🌐 Website 中文 OpenJudge is an open-source evaluation framework for AI applications (e.g., AI agents or chatbots) designed to evaluate quality and drive continuous application optimization. In practice, application excellence depends on a trustworthy evaluation workflow: Collect test data → Define graders → Run evaluatio

agentagent-skillsai-agentalignmentevaluationgraderllmrewardreward-modelrlhf

Quick Facts

Stars829
Forks67
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score60.0328618065128/100
Open Issues13
Last Updated2026-09-11
Created2025-07-08
Platformspython
Est. Tokens~18k

OpenJudge alternative? Top 6 similar tools

Looking for a OpenJudge alternative? If you're comparing OpenJudge with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • claude-code-plugins-plus-skills by jeremylongshore · ⭐ 2.7k

    471 plugins, 3,069 skills, 347 agents for Claude Code. Open-source marketplace at tonsofskills.com with the cc

  • trpc-agent-go by trpc-group · ⭐ 1.8k

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, eva

  • AgentChat by Shy2593666979 · ⭐ 872

    AgentChat 是一个基于 LLM 的智能体交流平台,内置默认 Agent 并支持用户自定义 Agent。通过多轮对话和任务协作,Agent 可以理解并协助完成复杂任务。项目集成 LangChain、Function

  • wcgw by rusiaaman · ⭐ 674

    Shell and coding agent on mcp clients

  • n8n-claw by freddy-schuetz · ⭐ 550

    OpenClaw-inspired autonomous AI agent built entirely in n8n. Adaptive RAG-powered memory, Skills via MCP templ

  • aser by AmeNetwork · ⭐ 472

    Aser is a lightweight, self-assembling AI Agent frame.

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is OpenJudge?

OpenJudge is OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards. It is categorized as a Agent Tool with 829 GitHub stars.

What programming language is OpenJudge written in?

OpenJudge is primarily written in Python. It covers topics such as agent, agent-skills, ai-agent.

How do I install or use OpenJudge?

You can find installation instructions and usage details in the OpenJudge GitHub repository at github.com/agentscope-ai/OpenJudge. The project has 829 stars and 67 forks, indicating an active community.

What license does OpenJudge use?

OpenJudge is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

What are the best alternatives to OpenJudge?

The top alternatives to OpenJudge on Agent Skills Hub include claude-code-plugins-plus-skills, trpc-agent-go, AgentChat. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy, covering 11 red-flag categories including credential harvesting, data exfiltration, and curl | sh installers. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools