jev-as-judge: what it is & alternatives

by patchy631 · AI Tool · ★ 69

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 52/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

Quick Facts

Stars69
Forks12
LanguagePython
CategoryAI Tool
Quality Score52/100
Last Updated2026-09-20
Created2026-09-20
Platformspython
Est. Tokens~15k

About jev-as-judge

Jev-as-a-Judge with Comet Opik A small, auditable example of evaluating refund-support traces with Jev and recording the results as an Opik experiment. What this project does Replays ten synthetic, frozen support traces, including correct answers, invented policies, false action claims, ambiguous wording, and an evaluator-injection attempt.

jev-as-judge alternative? Top 3 similar tools

Looking for a jev-as-judge alternative? If you're comparing jev-as-judge with other ai tool tools, these 3 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • redesigned-pancake by Sfedfcv · ⭐ 266

    Skip to content github / docs Code Issues 80 Pull requests 35 Discussions Actions Projects 2 Security Insights

  • claude-code-voice-skill by abracadabra50 · ⭐ 169

    Skill to talk to Claude about your projects over the phone

  • maui-skills by davidortinau · ⭐ 163

    .NET MAUI skills for GitHub Copilot and Claude Code

More AI Tool Tools

Explore other popular ai tool tools:

View all AI Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse AI Tool tools