No red flags found in any of the 11 categories — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →
by bigcode-project · Agent Tool · ★ 519
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
🔒 Is bigcodebench safe to install? View the security audit →
BigCodeBench 💥 Impact • 📰 News • 🔥 Quick Start • 🚀
| Stars | 519 |
| Forks | 74 |
| Language | Python |
| Category | Agent Tool |
| License | Apache-2.0 |
| Quality Score | 64.5815919159466/100 |
| Open Issues | 30 |
| Last Updated | 2026-01-03 |
| Created | 2024-04-29 |
| Platforms | claude-code, gemini, python |
| Est. Tokens | ~443k |
These tools work well together with bigcodebench for enhanced workflows:
Looking for a bigcodebench alternative? If you're comparing bigcodebench with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
🤖 Everything you need to create an LLM Agent—tools, prompts, frameworks, and models—all in one place.
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
This is the repository for the Tool Learning survey.
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
Desktop AI Assistant powered by GPT-6, GPT-5, Gemini, Claude, Ollama, Grok, DeepSeek, Perplexity, chat, agents
A curated list of awesome resources, tools, and other shiny things for LLM prompt engineering.
Explore other popular agent tool tools:
bigcodebench is [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI. It is categorized as a Agent Tool with 519 GitHub stars.
bigcodebench is primarily written in Python. It covers topics such as agent, agents, benchmark.
You can find installation instructions and usage details in the bigcodebench GitHub repository at github.com/bigcode-project/bigcodebench. The project has 519 stars and 74 forks, indicating an active community.
bigcodebench is released under the Apache-2.0 license, making it free to use and modify according to the license terms.
The top alternatives to bigcodebench on Agent Skills Hub include DemoGPT, kani, LLM-Tool-Survey. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.
Grades come from a rule-based scan built on the SlowMist agent-security taxonomy, covering 11 red-flag categories including credential harvesting, data exfiltration, and curl | sh installers. It is a first-layer scan, not a manual audit — we say so rather than overstate it.
The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.
Sources & who's responsible: