moonshot: A simple and modular tool to evaluate and red-team any LLM application

by aiverify-foundation · Agent Tool · ★ 355

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install moonshot

pip install "aiverify-moonshot[all]"
pip install aiverify-moonshot

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 69/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

benchmarkingevaluation-frameworkllmred-teamingtrustworthy-ai

Quick Facts

Stars355
Forks72
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score69/100
Open Issues3
Last Updated2026-06-10
Created2023-12-14
Platformspython
Est. Tokens~15282k

About moonshot

Version 0.7.6 A simple and modular tool to evaluate any LLM-based AI systems. 🎯 Motivation Developed by the AI Verify Foundation, Moonshot is a tool to bring Benchmarking and Red-Teaming together to help AI developers, compliance teams evaluate LLM-based Apps and LLMs.

Compatible Skills

These tools work well together with moonshot for enhanced workflows:

  • agentic-radar — semantic(0.35)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • AutoRedTeam-Orchestrator — semantic(0.34)+complementary+same_lang+similar_pop+shared_platform (57%)
  • SimpleLLMFunc — semantic(0.29)+complementary+same_lang+similar_pop+shared_platform (55%)
  • AI-Infra-Guard — semantic(0.22)+complementary+same_lang+similar_pop+shared_platform (53%)
  • agentseal — semantic(0.22)+complementary+same_lang+similar_pop+shared_platform (53%)

moonshot alternative? Top 6 similar tools

Looking for a moonshot alternative? If you're comparing moonshot with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • agentic-radar by splx-ai · ⭐ 1.1k

    A security scanner for your LLM agentic workflows

  • agentseal by getagentseal · ⭐ 382

    Security toolkit for AI agents. Scan your machine for dangerous skills and MCP configs, monitor for supply cha

  • bocoel by rentruewang · ⭐ 289

    Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 tim

  • Hegelion by Hmbown · ⭐ 172

    Dialectical reasoning architecture for LLMs (Thesis → Antithesis → Synthesis)

  • agentseal by AgentSeal · ⭐ 156

    Security toolkit for AI agents. Scan your machine for dangerous skills and MCP configs, monitor for supply cha

  • Awesome-LLM-Red-Teaming by user1342 · ⭐ 137

    A curated list of awesome LLM Red Teaming training, resources, and tools.

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools