ToolReplay: Audit AI agent tool-call transcripts: hash-chain sealing, deterministic replay, and scope overreach checks

by Matthew0822 · Agent Tool · ★ 171

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 71/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

ai-agentsauditclideterminismhash-chainjsonlpermissionspythonreplayscope

Quick Facts

Stars171
Forks18
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score71/100
Last Updated2026-09-14
Created2026-09-14
Platformscli, python
Est. Tokens~19k

About ToolReplay

ToolReplay ToolReplay audits a recorded transcript of an AI agent's tool calls and reports where the session was non-deterministic, redundant, or outside its declared permissions. Here is the tool working, right now, on the dirty sample that ships in this repository.

ToolReplay alternative? Top 6 similar tools

Looking for a ToolReplay alternative? If you're comparing ToolReplay with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • agent-skills-eval by darkrishabh · ⭐ 798

    A test runner for agentskills.io-style AI agent skills

  • roam-code by Cranot · ⭐ 517

    Local codebase intelligence CLI + MCP server for AI coding agents: SQLite code graph, 28 languages, 287 comman

  • cozempic by Ruya-AI · ⭐ 426

    Context cleaning for Claude Code — prune bloated sessions, protect Agent Teams from context loss, auto-guard w

  • kitaru by zenml-io · ⭐ 316

    Instill trust in your agent evals.

  • squirrelscan by squirrelscan · ⭐ 306

    The website QA tool for your coding agent. 310+ audit rules across SEO, performance, security, accessibility a

  • Dippy by ldayton · ⭐ 243

    🐤 Less permission fatigue, more momentum. Dippy knows what’s safe to run and keeps Claude on track when plans

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools