1.langfuse / langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
- analytics
- llm
- llmops
- large-language-models
- openai
- self-hosted
- +13 more
+10,474 stars
from 26,491 · score 9.26
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
16 repositories by Attention Score · May 8, 2026 – Nov 3, 2026 (UTC)
2.comet-ml / opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
- open-source
- langchain
- openai
- playground
- prompt-engineering
- llama-index
- +7 more
+4,165 stars
from 18,989 · score 8.33
3.openobserve / openobserve
Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
- logs
- metrics
- traces
- analytics
- elasticsearch
- jaeger
- +14 more
+4,129 stars
from 18,640 · score 8.33
4.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+3,042 stars
from 25,612 · score 8.02
5.Arize-ai / phoenix
AI Observability & Evaluation
- llmops
- ai-monitoring
- ai-observability
- llm-eval
- aiengineering
- datasets
- +10 more
+2,660 stars
from 9,464 · score 7.89
6.langwatch / langwatch
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
+1,794 stars
from 3,217 · score 7.49
7.mnfst / llm-gateway
Open Source LLM Gateway 🦚
- openclaw
- cost-tracking
- llm-observability
- token-tracking
- llm-router
- hermes-agent
- +9 more
+1,464 stars
from 6,150 · score 7.29
8.future-agi / future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
- ai-gateway
- observability
- simulation
- ai-agents
- ai-evals
- evaluation-framework
- +14 more
+1,384 stars
from 860 · score 7.23
9.hoangsonww / Claude-Code-Agent-Monitor
🚀 A real-time monitoring dashboard for Claude Code & Codex, built with SQLite3, Node.js, Express, React, Vite, TailwindCSS, & WebSockets. It tracks sessions, agent activity, tool usage, and subagent orchestration, providing live analytics, a Kanban status board, status notifications, a cute buddy, & an interactive web UI/MacOS/Windows native app.
- claude-agents
- claude-code
- claude-skills
- express
- expressjs
- node
- +14 more
+814 stars
from 326 · score 6.70
10.latitude-dev / latitude-llm
Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.
- llm-observability
- agent-monitoring
- agent-observability
- ai-error-monitor
- ai-monitoring
- ai-observability
- +2 more
+810 stars
from 3,934 · score 6.70
11.tensorzero / tensorzeroArchived
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
- ai
- artificial-intelligence
- deep-learning
- gpt
- llm
- llmops
- +14 more
+498 stars
from 11,210 · score 6.21
12.eunomia-bpf / agentsight
lightweight system-level observability for AI Agents
+459 stars
from 310 · score 6.13
13.raga-ai-hub / RagaAI-Catalyst
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
- llmops
- agentic-ai-development
- +6 more
+262 stars
from 15,927 · score 5.57
14.simple10 / agents-observe
Real-time observability of claude code sessions & multi-agents.
+185 stars
from 528 · score 5.23
15.disler / claude-code-hooks-multi-agent-observability
Real-time monitoring for Claude Code agents through simple hook event tracking.
+179 stars
from 1,387 · score 5.19
16.onllm-dev / onWatch
Track AI API quotas across Synthetic, Z.ai, Anthropic (Claude Code), Codex, GitHub Copilot & Antigravity in real time. Lightweight background daemon (<50MB RAM), SQLite storage, Material Design 3 dashboard. Zero telemetry.
- developer-tools
- golang
- quota-tracker
- ai-api-monitoring
- antigravity
- api-monitoring
- +4 more
+168 stars
from 601 · score 5.13