1.langfuse / langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
- analytics
- llm
- llmops
- large-language-models
- openai
- self-hosted
- +13 more
+4,574 stars
from 32,391 · score 8.43
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
16 repositories by Attention Score · Aug 6, 2026 – Nov 3, 2026 (UTC)
2.openobserve / openobserve
Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
- logs
- metrics
- traces
- analytics
- elasticsearch
- jaeger
- +14 more
+2,272 stars
from 20,497 · score 7.73
3.comet-ml / opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
- open-source
- langchain
- openai
- playground
- prompt-engineering
- llama-index
- +7 more
+2,148 stars
from 21,006 · score 7.67
4.langwatch / langwatch
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
+1,550 stars
from 3,461 · score 7.35
5.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+1,357 stars
from 27,297 · score 7.21
6.Arize-ai / phoenix
AI Observability & Evaluation
- llmops
- ai-monitoring
- ai-observability
- llm-eval
- aiengineering
- datasets
- +10 more
+1,270 stars
from 10,854 · score 7.15
7.future-agi / future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
- ai-gateway
- observability
- simulation
- ai-agents
- ai-evals
- evaluation-framework
- +14 more
+655 stars
from 1,589 · score 6.49
8.mnfst / llm-gateway
Open Source LLM Gateway 🦚
- openclaw
- cost-tracking
- llm-observability
- token-tracking
- llm-router
- hermes-agent
- +9 more
+279 stars
from 7,335 · score 5.63
9.hoangsonww / Claude-Code-Agent-Monitor
🚀 A real-time monitoring dashboard for Claude Code & Codex, built with SQLite3, Node.js, Express, React, Vite, TailwindCSS, & WebSockets. It tracks sessions, agent activity, tool usage, and subagent orchestration, providing live analytics, a Kanban status board, status notifications, a cute buddy, & an interactive web UI/MacOS/Windows native app.
- claude-agents
- claude-code
- claude-skills
- express
- expressjs
- node
- +14 more
+270 stars
from 870 · score 5.60
10.eunomia-bpf / agentsight
lightweight system-level observability for AI Agents
+218 stars
from 551 · score 5.39
11.latitude-dev / latitude-llm
Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.
- llm-observability
- agent-monitoring
- agent-observability
- ai-error-monitor
- ai-monitoring
- ai-observability
- +2 more
+204 stars
from 4,540 · score 5.32
12.raga-ai-hub / RagaAI-Catalyst
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
- llmops
- agentic-ai-development
- +6 more
+109 stars
from 16,080 · score 4.70
13.onllm-dev / onWatch
Track AI API quotas across Synthetic, Z.ai, Anthropic (Claude Code), Codex, GitHub Copilot & Antigravity in real time. Lightweight background daemon (<50MB RAM), SQLite storage, Material Design 3 dashboard. Zero telemetry.
- developer-tools
- golang
- quota-tracker
- ai-api-monitoring
- antigravity
- api-monitoring
- +4 more
+78 stars
from 691 · score 4.37
14.simple10 / agents-observe
Real-time observability of claude code sessions & multi-agents.
+75 stars
from 638 · score 4.33
15.disler / claude-code-hooks-multi-agent-observability
Real-time monitoring for Claude Code agents through simple hook event tracking.
+64 stars
from 1,502 · score 4.17
16.tensorzero / tensorzeroArchived
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
- ai
- artificial-intelligence
- deep-learning
- gpt
- llm
- llmops
- +14 more
+32 stars
from 11,676 · score 3.50