phoenix: AI Observability & Evaluation

by Arize-ai · LLM Plugin · ★ 12.2k

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install phoenix

pip install arize-phoenix

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 51/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

agentsai-monitoringai-observabilityaiengineeringanthropicdatasetsevalslangchainllamaindexllm-eval

Quick Facts

Stars12,191
Forks1,273
LanguagePython
CategoryLLM Plugin
Quality Score51/100
Open Issues1202
Last Updated2026-11-07
Created2022-11-09
Platformspython
Est. Tokens~22k

About phoenix

<img...

Compatible Skills

These tools work well together with phoenix for enhanced workflows:

  • logfire — semantic(0.39)+complementary+rare_topics+same_lang+similar_pop+shared_platform (68%)
  • lmnr — semantic(0.45)+complementary+rare_topics+similar_pop (64%)
  • just-eval — semantic(0.40)+complementary+rare_topics+same_lang+shared_platform (58%)
  • Kiln — semantic(0.20)+complementary+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • RagaAI-Catalyst — semantic(0.32)+complementary+same_lang+similar_pop+shared_platform (56%)

phoenix alternative? Top 6 similar tools

Looking for a phoenix alternative? If you're comparing phoenix with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • lmnr by lmnr-ai · ⭐ 3.5k

    Laminar - open-source observability platform purpose-built for AI agents. YC S24.

  • promptfoo by promptfoo · ⭐ 26.9k

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance

  • gateway by Portkey-AI · ⭐ 13.0k

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & fr

  • agentops by AgentOps-AI · ⭐ 5.8k

    Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and a

  • Kiln by Kiln-AI · ⭐ 5.3k

    Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation,

  • logfire by pydantic · ⭐ 4.5k

    AI observability platform for production LLM and agent systems.

More LLM Plugin Tools

Explore other popular llm plugin tools:

View all LLM Plugin tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse LLM Plugin tools