mint-bench: Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language

by xingyaoww · Agent Tool · ★ 144

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install mint-bench

git clone https://github.com/xingyaoww/mint-bench

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 67/100

Flagged: sudo usage. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

Quick Facts

Stars144
Forks11
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score67/100
Last Updated2024-06-04
Created2023-09-18
Platformspython
Est. Tokens~4821k

About mint-bench

MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback Official Repo for paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang\, Zihan Wang\, Jiateng Liu, Yangyi Chen, Lifan Yuan, Hao Peng and Heng Ji.

mint-bench alternative? Top 1 similar tools

Looking for a mint-bench alternative? If you're comparing mint-bench with other agent tool tools, these 1 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • claude-plugins by Kamalnrf · ⭐ 564

    Lightweight registry to discover, install, and manage all public Claude plugins and agent skills for your favo

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools