by mclenhard · MCP Server · ★ 132
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
npm install mcp-evalsTaken from the project's README on GitHub.
None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.
The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.
| Stars | 132 |
| Forks | 14 |
| Language | TypeScript |
| Category | MCP Server |
| License | MIT |
| Quality Score | 79/100 |
| Open Issues | 7 |
| Last Updated | 2025-06-23 |
| Created | 2025-04-23 |
| Platforms | mcp, node |
| Est. Tokens | ~14k |
MCP Evals A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring, with built-in observability support. This helps ensure your MCP server's tools are working correctly, performing well, and are fully observable with integrated monitoring and metrics.
Looking for a mcp-evals alternative? If you're comparing mcp-evals with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs
My Pi coding agent setup: secret redaction, LSP, searchable context, recall, telemetry, observability, and tea
Prefect MCP server
AgentEval is the comprehensive .NET toolkit for AI agent evaluation—tool usage validation, RAG quality metrics
An opinionated list of awesome Pydantic-AI frameworks, libraries, software and resources.
Run workflows, delegate to swarms, and verify outputs before you apply them.
Explore other popular mcp server tools:
Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.
The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.
Sources & who's responsible: