just-eval: A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs

by Re-Align · Agent Tool · ★ 90

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install just-eval

git clone https://github.com/Re-Align/just-eval.git
pip install git+https://github.com/Re-Align/just-eval.git

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 72/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

evaluationgpt4llmllm-evalllm-evaluationllm-evaluation-toolkit

Quick Facts

Stars90
Forks7
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score72/100
Open Issues2
Last Updated2024-01-29
Created2023-11-19
Platformspython
Est. Tokens~1201k

About just-eval

Just-Eval: A fine-grained evaluation of LLM Alignment This is part of the Re-Align project by AI2 Mosaic. Please find more information on our website: https://allenai.github.io/re-align/. Just-Eval-Instruct Dataset 💾 Check out our data on 🤗 Hugging Face: re-align/just-eval-instruct 📊 Check here for the leaderboard: https://allenai.github.io/re-align/justeval.html#leaderboard Data distribution...

just-eval alternative? Top 6 similar tools

Looking for a just-eval alternative? If you're comparing just-eval with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • skill-optimizer by fastxyz · ⭐ 81

    Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs

  • synkro by velocitybolt · ⭐ 67

    AI agent simulation framework

  • palico-ai by palico-ai · ⭐ 342

    Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

  • llms-tools by PetroIvaniuk · ⭐ 329

    A list of LLMs Tools & Projects

  • arag by Ayanami0730 · ⭐ 323

    A-RAG: Agentic Retrieval-Augmented Generation via Hierarchical Retrieval Interfaces. State-of-the-art RAG fram

  • bocoel by rentruewang · ⭐ 289

    Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 tim

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools