coder_eval: Playwright for coding agents

by UiPath · MCP Server · ★ 160

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install coder_eval

git clone https://github.com/UiPath/coder_eval.git

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 71/100

None of the 44 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

agent-evaluationagent-skillsagent-testinganthropicclaudeclaude-codeclaude-code-plugins-marketplaceclaude-code-skillsclaude-skillscodex

Quick Facts

Stars160
Forks9
LanguagePython
CategoryMCP Server
LicenseApache-2.0
Quality Score71/100
Open Issues27
Last Updated2026-11-19
Created2026-07-09
Platformsclaude-code, codex, gemini, mcp, python
Est. Tokens~15k

About coder_eval

codereval — evaluate AI coding agents & their skills A framework for evaluating AI coding agents and their skills — built for CLI and skill builders — with sandboxing, reproducibility, and data-driven analysis. Not an "agentic coding" benchmark: it measures how effective your CLI and skills are when used by coding agents. The Coding Agents Gym.

Compatible Skills

These tools work well together with coder_eval for enhanced workflows:

coder_eval alternative? Top 6 similar tools

Looking for a coder_eval alternative? If you're comparing coder_eval with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • claude-agent-builder by keysersoose · ⭐ 50

    Build production-ready AI agents in Claude Code from natural language. Analyzes your problem, researches best

  • horizon by peters · ⭐ 725

    GPU-accelerated terminal board that puts all your sessions on an infinite canvas

  • hcom by aannoo · ⭐ 650

    Let AI agents message, watch, and spawn each other across terminals. Claude Code, Codex, Antigravity CLI, Curs

  • awesome-claude-skills by karanb192 · ⭐ 595

    🎯 The definitive collection of 50+ verified Awesome Claude Skills for Claude Code, Claude.ai, and API. Boost

  • claude-code-skills by levnikolaevich · ⭐ 592

    Standalone skills for Claude Code and Codex: product discovery, architecture, implementation, technical founda

  • cursor-rules-java by jabrena · ⭐ 412

    An opinionated, AI-native development workflow for Java Enterprise — reusable Skills, Agents, Commands, and MC

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools