mcpmark: Comprehensive, stress-testing MCP benchmark designed to evaluate model and agent capabilities in real-world

by eval-sys · MCP Server · ★ 462

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install mcpmark

git clone https://github.com/eval-sys/mcpmark.git

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 70/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

agenticbenchmarkeval-sysmcpmcp-serversmcpmarktool-use

Quick Facts

Stars462
Forks48
LanguagePython
CategoryMCP Server
LicenseApache-2.0
Quality Score70/100
Open Issues21
Last Updated2026-06-12
Created2025-07-01
Platformsmcp, python
Est. Tokens~13k

About mcpmark

MCPMark: Stress-Testing Comprehensive MCP Use An evaluation suite for agentic models in real MCP tool environments (Notion / GitHub / Filesystem / Postgres / Playwright). MCPMark provides a reproducible, extensible benchmark for researchers and engineers: one-command tasks, isolated sandboxes, auto-resume for failures, unified metrics, and aggregated reports.

mcpmark alternative? Top 6 similar tools

Looking for a mcpmark alternative? If you're comparing mcpmark with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • forgemax by postrv · ⭐ 153

    Code Mode inspired local sandboxed MCP Gateway - collapses N servers x M tools into 2 tools (~1,000 tokens)

  • mcp-router by mcp-router · ⭐ 2.1k

    MCP Router — development, support and security updates ended 2026-09-18. Historical source and final release f

  • mcpso by chatmcp · ⭐ 2.1k

    directory for Awesome MCP Servers

  • mcphub.nvim by ravitemer · ⭐ 1.8k

    An MCP client for Neovim that seamlessly integrates MCP servers into your editing workflow with an intuitive i

  • tools by strands-agents · ⭐ 1.3k

    A set of tools that gives agents powerful capabilities.

  • mcp-searxng by ihor-sokoliuk · ⭐ 1.3k

    Private web search for AI assistants via SearXNG — supports Claude, Cursor, and any MCP client

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools