1.langfuse / langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
- analytics
- llm
- llmops
- large-language-models
- openai
- self-hosted
- +13 more
+4,574 stars
from 32,391 · score 8.43
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
8 repositories by Attention Score · Aug 6, 2026 – Nov 3, 2026 (UTC)
2.openobserve / openobserve
Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
- logs
- metrics
- traces
- analytics
- elasticsearch
- jaeger
- +14 more
+2,272 stars
from 20,497 · score 7.73
3.comet-ml / opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
- open-source
- langchain
- openai
- playground
- prompt-engineering
- llama-index
- +7 more
+2,148 stars
from 21,006 · score 7.67
4.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+1,357 stars
from 27,297 · score 7.21
5.Arize-ai / phoenix
AI Observability & Evaluation
- llmops
- ai-monitoring
- ai-observability
- llm-eval
- aiengineering
- datasets
- +10 more
+1,270 stars
from 10,854 · score 7.15
6.raga-ai-hub / RagaAI-Catalyst
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
- llmops
- agentic-ai-development
- +6 more
+109 stars
from 16,080 · score 4.70
7.onllm-dev / onWatch
Track AI API quotas across Synthetic, Z.ai, Anthropic (Claude Code), Codex, GitHub Copilot & Antigravity in real time. Lightweight background daemon (<50MB RAM), SQLite storage, Material Design 3 dashboard. Zero telemetry.
- developer-tools
- golang
- quota-tracker
- ai-api-monitoring
- antigravity
- api-monitoring
- +4 more
+78 stars
from 691 · score 4.37
8.tensorzero / tensorzeroArchived
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
- ai
- artificial-intelligence
- deep-learning
- gpt
- llm
- llmops
- +14 more
+32 stars
from 11,676 · score 3.50