1.langfuse / langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
- analytics
- llm
- llmops
- large-language-models
- openai
- self-hosted
- +13 more
+350 stars
from 36,615 · score 5.86
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
19 repositories by Attention Score · Oct 28, 2026 – Nov 3, 2026 (UTC)
2.openobserve / openobserve
Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
- logs
- metrics
- traces
- analytics
- elasticsearch
- jaeger
- +14 more
+244 stars
from 22,525 · score 5.50
3.ThinkWatchProject / ThinkWatch-Lite
Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.
- ai-gateway
- anthropic
- claude-code
- codex
- cost-tracking
- llm-gateway
- +14 more
+237 stars
from 347 · score 5.47
4.comet-ml / opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
- open-source
- langchain
- openai
- playground
- prompt-engineering
- llama-index
- +7 more
+179 stars
from 22,975 · score 5.19
5.Cygnux-Labs / Tracekit
Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
- agent-security
- ai-agents
- audit-log
- claude-code
- llm
- mcp
- +14 more
+129 stars
from 259 · score 4.87
6.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+91 stars
from 28,563 · score 4.52
7.Arize-ai / phoenix
AI Observability & Evaluation
- llmops
- ai-monitoring
- ai-observability
- llm-eval
- aiengineering
- datasets
- +10 more
+91 stars
from 12,033 · score 4.52
8.future-agi / future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
- ai-gateway
- observability
- simulation
- ai-agents
- ai-evals
- evaluation-framework
- +14 more
+33 stars
from 2,211 · score 3.53
9.hoangsonww / Claude-Code-Agent-Monitor
🚀 A real-time monitoring dashboard for Claude Code & Codex, built with SQLite3, Node.js, Express, React, Vite, TailwindCSS, & WebSockets. It tracks sessions, agent activity, tool usage, and subagent orchestration, providing live analytics, a Kanban status board, status notifications, a cute buddy, & an interactive web UI/MacOS/Windows native app.
- claude-agents
- claude-code
- claude-skills
- express
- expressjs
- node
- +14 more
+16 stars
from 1,124 · score 2.83
10.langwatch / langwatch
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
+15 stars
from 4,996 · score 2.77
11.eunomia-bpf / agentsight
lightweight system-level observability for AI Agents
+13 stars
from 756 · score 2.64
12.jwuthri-cloud / Tracely-ai
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.
- agent-evaluation
- ai-agents
- ai-testing
- ci-cd
- clickhouse
- developer-tools
- +9 more
+11 stars
from 1,202 · score 2.48
13.mnfst / llm-gateway
Open Source LLM Gateway 🦚
- openclaw
- cost-tracking
- llm-observability
- token-tracking
- llm-router
- hermes-agent
- +9 more
+10 stars
from 7,604 · score 2.40
14.disler / claude-code-hooks-multi-agent-observability
Real-time monitoring for Claude Code agents through simple hook event tracking.
+8 stars
from 1,558 · score 2.20
15.onllm-dev / onWatch
Track AI API quotas across Synthetic, Z.ai, Anthropic (Claude Code), Codex, GitHub Copilot & Antigravity in real time. Lightweight background daemon (<50MB RAM), SQLite storage, Material Design 3 dashboard. Zero telemetry.
- developer-tools
- golang
- quota-tracker
- ai-api-monitoring
- antigravity
- api-monitoring
- +4 more
+7 stars
from 762 · score 2.08
16.raga-ai-hub / RagaAI-Catalyst
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
- llmops
- agentic-ai-development
- +6 more
+6 stars
from 16,183 · score 1.95
17.latitude-dev / latitude-llm
Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.
- llm-observability
- agent-monitoring
- agent-observability
- ai-error-monitor
- ai-monitoring
- ai-observability
- +2 more
+6 stars
from 4,738 · score 1.95
18.ColeMurray / claude-code-otel
A comprehensive observability solution for monitoring Claude Code usage, performance, and costs.
+5 stars
from 515 · score 1.79
19.simple10 / agents-observe
Real-time observability of claude code sessions & multi-agents.
+2 stars
from 711 · score 1.10