AlgoTune: NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems

by oripress · Agent Tool · ★ 119

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 69/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

code-agentcode-generationcode-optimizationllm-agentllm-benchmarkingllm-coder

Quick Facts

Stars119
Forks15
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score69/100
Open Issues2
Last Updated2026-06-24
Created2025-07-02
Platformspython
Est. Tokens~15k

About AlgoTune

Website  |   Paper How good are language models at coming up with new algorithms? To try to answer this, we built a benchmark, AlgoTune, comprised of 154 widely used math, physics, and computer science functions. For each function, the goal is to write code that produces the same outputs as the original function, while being faster.

Compatible Skills

These tools work well together with AlgoTune for enhanced workflows:

AlgoTune alternative? Top 6 similar tools

Looking for a AlgoTune alternative? If you're comparing AlgoTune with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • DM-Code-Agent by hwfengcs · ⭐ 151

    Local-first, auditable Python code agent. Ships its own 30-task hidden-test benchmark plus SWE-bench Verified

  • PairCoder by nju-websoft · ⭐ 114

    A Pair Programming Framework for Code Generation via Multi-Plan Exploration and Feedback-Driven Refinement, AS

  • Roy by JosefAlbers · ⭐ 79

    Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language mo

  • MyAgents by hAcKlyc · ⭐ 592

    MyAgents - 优雅、易用的 Agent 桌面端 ,一站式 Agent 工作台与任务中心

  • RepoMaster by QuantaAlpha · ⭐ 542

    RepoMaster: The open-source AI agent that masters GitHub. It turns any code repository into a powerful tool, a

  • bigcodebench by bigcode-project · ⭐ 519

    [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools