LLM-Agent-Benchmark-List: A banchmark list for evaluation of large language models

by zhangxjohn · Agent Tool · ★ 173

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 54/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

agentbenchmarklarge-language-modelsllmsurvey

Quick Facts

Stars173
Forks18
CategoryAgent Tool
LicenseApache-2.0
Quality Score54/100
Open Issues4
Last Updated2026-11-05
Created2024-01-29
Est. Tokens~11k

About LLM-Agent-Benchmark-List

LLM-Agent-Benchmark-List 🤗We greatly appreciate any contributions via PRs, issues, emails, or other methods. ⏳ Continuous update... :book: Introduction In the swiftly evolving landscape of artificial intelligence, Large Language Models (LLMs) have emerged as a pivotal cornerstone, revolutionizing how we interact with and harness the power of natural language processing.

LLM-Agent-Benchmark-List alternative? Top 6 similar tools

Looking for a LLM-Agent-Benchmark-List alternative? If you're comparing LLM-Agent-Benchmark-List with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • bigcodebench by bigcode-project · ⭐ 519

    [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

  • LLM-Tool-Survey by quchangle1 · ⭐ 489

    This is the repository for the Tool Learning survey.

  • OpenRCA by microsoft · ⭐ 450

    [ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures?

  • awesome-lifelong-llm-agent by qianlima-lab · ⭐ 341

    TPAMI 2026 | This repository collects awesome survey, resource, and paper for lifelong learning LLM agents

  • LLM-Brained-GUI-Agents-Survey by vyokky · ⭐ 232

    GitHub page for "Large Language Model-Brained GUI Agents: A Survey"

  • Awesome-LLM-Papers-Comprehensive-Topics by shure-dev · ⭐ 223

    Awesome LLM Papers and repos on very comprehensive topics.

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools