litmus: Comprehensive LLM testing and evaluation tool designed for GenAI Application Development

by google · LLM Plugin · ★ 52

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 60/100

Flagged: sudo usage. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

apiapitestingcicddevopsllmllm-evaluationllm-securityllm-trainingllmopstesting

Quick Facts

Stars52
Forks10
LanguageVue
CategoryLLM Plugin
LicenseApache-2.0
Quality Score60/100
Open Issues5
Last Updated2026-11-03
Created2024-06-13
Est. Tokens~17k

About litmus

Litmus: A comprehensive LLM testing and evaluation tool designed for GenAI Application Development. Litmus is a comprehensive tool designed for testing and evaluating HTTP Requests and Responses, especially for Large Language Models (LLMs). It combines a powerful API, a robust worker service, a user-friendly web interface, and an optional proxy service to streamline the testing process.

Compatible Skills

These tools work well together with litmus for enhanced workflows:

  • reverse-check — semantic(0.16)+complementary+same_lang+similar_pop (51%)
  • just-eval — semantic(0.43)+complementary+similar_pop (50%)

litmus alternative? Top 6 similar tools

Looking for a litmus alternative? If you're comparing litmus with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • Awesome-LLMs-ICLR-24 by azminewasi · ⭐ 73

    It is a comprehensive resource hub compiling all LLM papers accepted at the International Conference on Learni

  • J.A.R.V.I.S.2.0 by ganeshnikhil · ⭐ 243

    open source assistant hybrid using small models (2b - 5b) and gemini , with image and agentic tool capabilit

  • lazy-bird by yusufkaraaslan · ⭐ 239

    Universal development automation for ANY project. Claude Code implements features, runs tests, creates PRs aut

  • lihil by raceychan · ⭐ 217

    2X faster ASGI web framework for python, offering high-level development, low-level performance.

  • Awesome-Multi-Token-Prediction by Xiaohao-Liu · ⭐ 215

    A curated list of papers, tools, and resources on Multi-Token Prediction (MTP) and related techniques in Large

  • facebook-ads-library-mcp by talknerdytome-labs · ⭐ 189

    MCP Server for Facebook ADs Library - Get instant answers from FB's ad library

More LLM Plugin Tools

Explore other popular llm plugin tools:

View all LLM Plugin tools →

Popular Vue Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse LLM Plugin tools