awesome-agent-observability: Curated list of LLM and AI agent observability and evaluation tools

by anhermon · MCP Server · ★ 64

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 59/100

None of the 44 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

agent-evaluationagent-observabilityai-agentsai-observabilityawesomeawesome-listevalsevaluationguardrailsllm

Quick Facts

Stars64
Forks35
LanguagePython
CategoryMCP Server
LicenseCC0-1.0
Quality Score59/100
Open Issues1
Last Updated2026-11-19
Created2026-07-01
Platformsmcp, python
Est. Tokens~16k

About awesome-agent-observability

Awesome Agent Observability Curated tools, standards, and platforms for tracing, evaluating, and governing LLM and AI-agent applications. Agents fail in ways ordinary services do not: a run is non-deterministic, spans a dozen model and tool calls, and "wrong" is a quality judgement rather than a status code.

awesome-agent-observability alternative? Top 6 similar tools

Looking for a awesome-agent-observability alternative? If you're comparing awesome-agent-observability with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • tma1 by tma1-ai · ⭐ 124

    Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into th

  • langfuse-mcp by avivsinai · ⭐ 112

    A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanc

  • agent-trace by Siddhant-K-code · ⭐ 108

    Local evidence and replay for coding agents: replay what happened, see what the trace could not prove, and att

  • DM-Code-Agent by hwfengcs · ⭐ 152

    An inspectable coding agent. Trace changes, diagnose failed runs, and share test evidence. Local-first Python,

  • eval-view by hidai25 · ⭐ 142

    Regression testing for AI agents. Snapshot behavior,diff tool calls,catch regressions in CI. Works with LangGr

  • preloop by preloop · ⭐ 95

    The open-source AI agent control plane and software factory: govern every tool and model call.

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools