Find AI tools for monitoring applications, logs, metrics, and system health with intelligent alerting.
Open-source AI copilot that lets you chat with your observability data and code ๐งโโ๏ธ
Local-first observability for AI agents. Tokens, cost, latency, and traces โ stored locally, queryable with SQL.
DataOps Observability Integration Agents are part of DataKitchen's Open Source Data Observability. They connect to various ETL, ELT, BI, data science, data visualization, data governance, and data analytic tools. They provide logs, messages, metrics, overall run-time start/stop, subtask status, and scheduling information to DataOps Observability.
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
๐ช A lightweight, modern Kubernetes dashboard that unifies multi-cluster and resource management, enterprise-grade user governance (OAuth, RBAC, and audit logs), and AI agents in one workspace. Not just a tool, but more like a platform.
Langtrace ๐ is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. ๐๐ป๐
๐ LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). ๐ Extracts signals from prompts & responses, ensuring safety & security. ๐ก๏ธ Features include text quality, relevance metrics, & sentiment analysis. ๐ A comprehensive tool for LLM observability. ๐
Official plugin for OpenClaw that exports agent traces to Opik. See and monitor agent behaviour, cost, tokens, errors and more.
See your agent think. Real-time observability dashboard for OpenClaw AI agents.
| Tool | Stars | Language | License | Score |
|---|---|---|---|---|
| vespper | ★ 357 | TypeScript | Apache-2.0 | 29 |
| logfire | ★ 4.1k | Python | MIT | 42 |
| tma1 | ★ 54 | JavaScript | Apache-2.0 | 33 |
| dataops-observability-agents | ★ 31 | Python | Apache-2.0 | 34 |
| RagaAI-Catalyst | ★ 16.1k | Python | Apache-2.0 | 42 |
| kite | ★ 2.5k | TypeScript | Apache-2.0 | 42 |
| langtrace | ★ 1.2k | TypeScript | AGPL-3.0 | 38 |
| langkit | ★ 976 | Jupyter Notebook | Apache-2.0 | 32 |
| opik-openclaw | ★ 319 | TypeScript | Apache-2.0 | 40 |
| clawmetry | ★ 205 | Python | MIT | 38 |
The top monitoring & observability tools include vespper, logfire, tma1. These are ranked by our composite score based on GitHub stars, community activity, and code quality.
Most tools listed here are open-source. 10 out of 10 have explicit open-source licenses, making them free to use and modify.
Consider your tech stack (language compatibility), project scale (stars indicate community trust), and specific features you need. Use the comparison table above to evaluate side by side.
Top 20 fastest-growing AI tools delivered every Monday. Free.
No spam, unsubscribe anytime.