tau2-bench: τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

by sierra-research · LLM Plugin · ★ 2.4k

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install tau2-bench

git clone https://github.com/sierra-research/tau2-bench

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 74/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

aibenchmarkconversational-agentslanguage-model-agentllm

Quick Facts

Stars2,377
Forks621
LanguagePython
CategoryLLM Plugin
LicenseMIT
Quality Score74/100
Open Issues336
Last Updated2026-11-02
Created2025-06-09
Platformspython
Est. Tokens~15k

About tau2-bench

$\tau$-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains 🚀 τ³-bench is here! From text-only to multimodal, knowledge-aware agent evaluation. Voice full-duplex · Knowledge ret

Compatible Skills

These tools work well together with tau2-bench for enhanced workflows:

  • mcpmark — semantic(0.42)+complementary+rare_topics+same_lang+similar_pop+shared_platform (64%)
  • MCPBench — semantic(0.27)+complementary+rare_topics+same_lang+similar_pop+shared_platform (59%)
  • MLLM-Tool — semantic(0.35)+complementary+same_lang+similar_pop+shared_platform (57%)
  • Toucan — semantic(0.23)+complementary+same_lang+similar_pop+shared_platform (53%)
  • mcp-bench — semantic(0.20)+complementary+same_lang+similar_pop+shared_platform (52%)

tau2-bench alternative? Top 6 similar tools

Looking for a tau2-bench alternative? If you're comparing tau2-bench with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • AI-Infra-Guard by Tencent · ⭐ 6.4k

    A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Sca

  • MemMachine by MemMachine · ⭐ 3.1k

    Universal memory layer for AI Agents. It provides scalable, extensible, and interoperable memory storage and r

  • lemonade by lemonade-sdk · ⭐ 6.1k

    Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NP

  • klavis by Klavis-AI · ⭐ 5.8k

    [DEPRECATED] Legacy Klavis AI MCP integrations. See klavis.ai for RL environments and training data.

  • code-graph-rag by vitali87 · ⭐ 5.3k

    The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI

  • Viper by FunnyWolf · ⭐ 5.3k

    Adversary simulation and Red teaming platform with AI

More LLM Plugin Tools

Explore other popular llm plugin tools:

View all LLM Plugin tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse LLM Plugin tools