jevbench: JevBench by Benchmark Heaven: benchmark and leaderboard for AI decision models, measuring typed decision

by fstandhartinger · AI Tool · ★ 300

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 52/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

ai-benchmarkbenchmark-heavencalibrationdecision-modelsdecisionmodelsjevjev-compatiblejevbenchleaderboardmachine-learning

Quick Facts

Stars300
Forks28
LanguagePython
CategoryAI Tool
LicenseMIT
Quality Score52/100
Open Issues178
Last Updated2026-10-15
Created2026-09-19
Platformspython
Est. Tokens~19k

About jevbench

JevBench A benchmark for Jev-class decision models: you hand the model a piece of state and a bounded rubric, and it hands back a typed answer, ideally with a probability for every option. No prose, no parsing, no "as an AI language model". JevBench is Benchmark Heaven's own benchmark. It is not affiliated with or endorsed by TypeSafe AI, whose Jev model is one of the systems measured here.

Compatible Skills

These tools work well together with jevbench for enhanced workflows:

  • open-alternative-jev — semantic(0.25)+complementary+same_lang+similar_pop+shared_platform (59%)
  • OpenDecision — semantic(0.21)+complementary+same_lang+similar_pop+shared_platform (58%)
  • Verdict-open-jev — semantic(0.20)+complementary+same_lang+similar_pop+shared_platform (57%)

jevbench alternative? Top 6 similar tools

Looking for a jevbench alternative? If you're comparing jevbench with other ai tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • ollaya by ollaya-dev · ⭐ 1.4k

    Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible

  • awesome-typesafe-jev by AbdelStark · ⭐ 601

    Awesome Jev: a source-backed field guide to TypeSafe's System One model, with SDKs, live demos, agent tools, a

  • awesome-jev-gallery by OmniJev · ⭐ 473

    🔥🔥 Awesome Jev: open-source models, projects, benchmarks, and independent evaluations for Jev and System On

  • jevk5 by allebee · ⭐ 158

    JevK5: open-weight alternative to TypeSafe Jev. Typed decisions with probabilities in one forward pass; Apache

  • awesome-jev by Promethe-us · ⭐ 147

    A source-backed Jev / System One knowledge map: projects, papers, evaluations, robotics, and social discovery.

  • awesome-jev by OmniJev · ⭐ 65

    🔥🔥 Papers, open reproductions and independent evaluations behind System One models and Jev.

More AI Tool Tools

Explore other popular ai tool tools:

View all AI Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse AI Tool tools