skill-optimizer: Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs

by fastxyz · MCP Server · ★ 85

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install skill-optimizer

/plugin marketplace add fastxyz/skill-optimizer
/plugin install skill-optimizer@skill-optimizer

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 72/100

None of the 44 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

aiai-agentai-skillbenchmarkclievalevalsevaluationevaluation-frameworkllm

Quick Facts

Stars85
Forks14
LanguageTypeScript
CategoryMCP Server
LicenseMIT
Quality Score72/100
Open Issues15
Last Updated2026-05-28
Created2026-03-06
Platformscli, mcp, node
Est. Tokens~150k

About skill-optimizer

skill-optimizer Docker workbench and Agent Skill for running deterministic evals against agent skills. Use this repo in two ways: Install the skill/plugin into your agent so it can author and debug eval suites. Run the local CLI to execute cases and suites in Docker against OpenRouter models. Installation Installation differs by agent.

Compatible Skills

These tools work well together with skill-optimizer for enhanced workflows:

  • inkbox — semantic(0.20)+complementary+same_lang+similar_pop+shared_platform (52%)
  • ai-sdk-provider-opencode-sdk — semantic(0.20)+complementary+same_lang+similar_pop+shared_platform (52%)

skill-optimizer alternative? Top 6 similar tools

Looking for a skill-optimizer alternative? If you're comparing skill-optimizer with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • gopher-mcp by GopherSecurity · ⭐ 155

    C++ MCP SDK - build Model Context Protocol (MCP) servers and clients in C++ / CPP. Enterprise-grade security,

  • LLM_trader by qrak · ⭐ 141

    An LLM trading agent that shows its work: the chart, the prompt, the memory it retrieved, and every loss. Pape

  • litefuse by litefuse · ⭐ 113

    Litefuse - Agent Observability and Evaluation Platform

  • swival by Swival · ⭐ 360

    A small, powerful, open-source CLI coding agent that works with open models.

  • utcp-mcp by universal-tool-calling-protocol · ⭐ 221

    All-in-one MCP server that can connect your AI agents to any native endpoint, powered by UTCP

  • AutoDocs by TrySita · ⭐ 196

    We handle what engineers and IDEs won't: generating and maintaining technical documentation for your codebase,

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular TypeScript Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools