ToolQA: ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external

by night-chen · Agent Tool · ★ 287

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 68/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

large-language-modelsnatural-language-understandingnatural-lauguage-processingquestion-answeringtools

Quick Facts

Stars287
Forks14
LanguageJupyter Notebook
CategoryAgent Tool
LicenseApache-2.0
Quality Score68/100
Open Issues5
Last Updated2023-08-19
Created2023-06-06
Est. Tokens~24k

About ToolQA

🛠️ToolQA 🛠️ The official repository for code and data of ToolQA dataset. ToolQA is a open-source dataset specifically designed for evaluations on tool-augmented large language models (LLMs). This repo provides the dataset, the corresponding data generation code, and the implementations of baselines on our dataset.

ToolQA alternative? Top 6 similar tools

Looking for a ToolQA alternative? If you're comparing ToolQA with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • rubra by rubra-ai · ⭐ 154

    Open Weight, tool-calling LLMs

  • spacy-llm by explosion · ⭐ 1.4k

    🦙 Integrating LLMs into structured NLP pipelines

  • jupyter-mcp-server by datalayer · ⭐ 1.3k

    🪐 🔧 Model Context Protocol (MCP) Server for Jupyter.

  • awesome-ai-sdks by e2b-dev · ⭐ 1.2k

    A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonom

  • compose-for-agents by docker · ⭐ 1.0k

    Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestrating open-sou

  • mcpm.sh by pathintegral-institute · ⭐ 1.0k

    CLI MCP package manager & registry for all platforms and all clients. Search & configure MCP servers. Advanced

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Jupyter Notebook Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools