1.langfuse / langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
- analytics
- llm
- llmops
- large-language-models
- openai
- self-hosted
- +13 more
+350 stars
from 36,615 · score 5.86
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
9 repositories by Attention Score · Oct 28, 2026 – Nov 3, 2026 (UTC)
2.openobserve / openobserve
Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
- logs
- metrics
- traces
- analytics
- elasticsearch
- jaeger
- +14 more
+244 stars
from 22,525 · score 5.50
3.ThinkWatchProject / ThinkWatch-Lite
Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.
- ai-gateway
- anthropic
- claude-code
- codex
- cost-tracking
- llm-gateway
- +14 more
+237 stars
from 347 · score 5.47
4.comet-ml / opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
- open-source
- langchain
- openai
- playground
- prompt-engineering
- llama-index
- +7 more
+179 stars
from 22,975 · score 5.19
5.Cygnux-Labs / Tracekit
Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
- agent-security
- ai-agents
- audit-log
- claude-code
- llm
- mcp
- +14 more
+129 stars
from 259 · score 4.87
6.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+91 stars
from 28,563 · score 4.52
7.jwuthri-cloud / Tracely-ai
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.
- agent-evaluation
- ai-agents
- ai-testing
- ci-cd
- clickhouse
- developer-tools
- +9 more
+11 stars
from 1,202 · score 2.48
8.onllm-dev / onWatch
Track AI API quotas across Synthetic, Z.ai, Anthropic (Claude Code), Codex, GitHub Copilot & Antigravity in real time. Lightweight background daemon (<50MB RAM), SQLite storage, Material Design 3 dashboard. Zero telemetry.
- developer-tools
- golang
- quota-tracker
- ai-api-monitoring
- antigravity
- api-monitoring
- +4 more
+7 stars
from 762 · score 2.08
9.raga-ai-hub / RagaAI-Catalyst
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
- llmops
- agentic-ai-development
- +6 more
+6 stars
from 16,183 · score 1.95