Flagged: sudo usage. Scanned against the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →
by hkust-nlp · Agent Tool · ★ 486
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
🔒 Is Toolathlon safe to install? View the security audit →
The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution Introduction Toolathlon is a benchmark to assess language agents' general tool use in realistic environments. It features 600+ diverse tools based on real-world software environments. Each task requires long-horizon tool calls to complete. Below we show a demo task where the agent needs to automatically check assignments in the email box, and grade them on Canvas. News [2025.12.12] 📣 We have setup a new doc
| Stars | 486 |
| Forks | 66 |
| Language | Python |
| Category | Agent Tool |
| Quality Score | 69.2208527991315/100 |
| Open Issues | 25 |
| Last Updated | 2026-08-18 |
| Created | 2025-10-24 |
| Platforms | python |
| Est. Tokens | ~17k |
Looking for a Toolathlon alternative? If you're comparing Toolathlon with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
This repository contains a collection of Agent Skills developed by GudaStudio, enabling seamless collaboration
A collection of standardized Agent Skills to teach GitHub Copilot, Claude, Gemini and Cursor about modern Andr
Claude Code Skill Factory — A powerful open-source toolkit for building and deploying production-ready Claude
A collection of Agent skills and Claude Code plugins for HashiCorp products.
Lightweight registry to discover, install, and manage all public Claude plugins and agent skills for your favo
A Claude Code skill that turns PDFs, docs, and codebases into Obsidian study vaults
Explore other popular agent tool tools:
Toolathlon is [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution. It is categorized as a Agent Tool with 486 GitHub stars.
Toolathlon is primarily written in Python.
You can find installation instructions and usage details in the Toolathlon GitHub repository at github.com/hkust-nlp/Toolathlon. The project has 486 stars and 66 forks, indicating an active community.
The top alternatives to Toolathlon on Agent Skills Hub include skills, awesome-android-agent-skills, claude-code-skill-factory. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.
Grades come from a rule-based scan built on the SlowMist agent-security taxonomy, covering 11 red-flag categories including credential harvesting, data exfiltration, and curl | sh installers. It is a first-layer scan, not a manual audit — we say so rather than overstate it.
The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.
Sources & who's responsible: