ruby_llm-tribunal: LLM evaluation framework for Ruby, powered by RubyLLM

by Alqemist-labs · Agent Tool · ★ 71

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install ruby_llm-tribunal

git clone https://github.com/Alqemist-labs/ruby_llm-tribunal

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 74/100

None of the 44 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

Quick Facts

Stars71
Forks7
LanguageRuby
CategoryAgent Tool
LicenseMIT
Quality Score74/100
Open Issues2
Last Updated2026-04-09
Created2026-01-15
Platformsruby
Est. Tokens~5k

About ruby_llm-tribunal

RubyLLM::Tribunal ⚖️ LLM evaluation framework for Ruby, powered by RubyLLM. Tribunal provides tools for evaluating and testing LLM outputs, detecting hallucinations, measuring response quality, and ensuring safety. Perfect for RAG systems, chatbots, and any LLM-powered application. Inspired by the excellent Tribunal library for Elixir.

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Ruby Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools