bigcodebench — Agent Tool by bigcode-project

by bigcode-project · Agent Tool · ★ 485

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

About bigcodebench

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

agentagentsbenchmarkchatgptclaude-3code-generationdeepseekfunction-callinggeminigpt-4

Quick Facts

Stars485
Forks64
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score34.75/100
Open Issues27
Last Updated2026-01-03
Created2024-04-29
Platformsclaude-code, gemini, python
Est. Tokens~443k

Compatible Skills

These tools work well together with bigcodebench for enhanced workflows:

  • gptme — semantic(0.18)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)
  • cursor-agent — semantic(0.16)+complementary+same_lang+similar_pop+shared_platform (56%)
  • agent-studio — semantic(0.16)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • PairCoder — semantic(0.38)+rare_topics+same_lang+similar_pop+shared_platform (52%)
  • mcp-gemini-search — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

bigcodebench alternative? Top 6 similar tools

Looking for a bigcodebench alternative? If you're comparing bigcodebench with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • npi by sheet0 · ⭐ 228

    Action library for AI Agent

  • DemoGPT by melih-unsal · ⭐ 1.9k

    🤖 Everything you need to create an LLM Agent—tools, prompts, frameworks, and models—all in one place.

  • kani by zhudotexe · ⭐ 599

    kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)

  • LLM-Tool-Survey by quchangle1 · ⭐ 481

    This is the repository for the Tool Learning survey.

  • awesome-llm-powered-agent by hyp1231 · ⭐ 2.2k

    Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

  • py-gpt by szczyglis-dev · ⭐ 1.7k

    Desktop AI Assistant powered by GPT-5, GPT-4, o1, o3, Gemini, Claude, Ollama, DeepSeek, Perplexity, Grok, Biel

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is bigcodebench?

bigcodebench is [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI. It is categorized as a Agent Tool with 485 GitHub stars.

What programming language is bigcodebench written in?

bigcodebench is primarily written in Python. It covers topics such as agent, agents, benchmark.

How do I install or use bigcodebench?

You can find installation instructions and usage details in the bigcodebench GitHub repository at github.com/bigcode-project/bigcodebench. The project has 485 stars and 64 forks, indicating an active community.

What license does bigcodebench use?

bigcodebench is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

What are the best alternatives to bigcodebench?

The top alternatives to bigcodebench on Agent Skills Hub include npi, DemoGPT, kani. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse Agent Tool tools