llm-d-benchmark: llm-d benchmark scripts and tooling

by llm-d · Agent Tool · ★ 79

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install llm-d-benchmark

git clone https://github.com/llm-d/llm-d-benchmark.git

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 67/100

None of the 44 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

benchmarkingllm-evaluation

Quick Facts

Stars79
Forks166
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score67/100
Open Issues72
Last Updated2026-11-19
Created2025-05-13
Platformspython
Est. Tokens~25k

About llm-d-benchmark

llm-d-benchmark [![.github/workflows/ci-nightly-benchmark-ocp-standalone.yaml](https://github.com/llm-d/llm-d-benchmark/actions/workflows/

llm-d-benchmark alternative? Top 6 similar tools

Looking for a llm-d-benchmark alternative? If you're comparing llm-d-benchmark with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • opencode-skill-creator by antongulin · ⭐ 193

    Create, test, and optimize OpenCode skills. Supports OpenCode V2 and V1 ≥ 1.18.29. Adapted from Anthropic's sk

  • moonshot by aiverify-foundation · ⭐ 361

    Moonshot - A simple and modular tool to evaluate and red-team any LLM application.

  • palico-ai by palico-ai · ⭐ 343

    Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

  • llms-tools by PetroIvaniuk · ⭐ 331

    A list of LLMs Tools & Projects

  • bocoel by rentruewang · ⭐ 288

    Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 tim

  • WebCanvas by iMeanAI · ⭐ 282

    All-in-one Web Agent framework for post-training. Start building with a few clicks!

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools