1.confident-ai / deepeval
The LLM Evaluation Framework
Ranked by Attention Score: stars gained over the last 180 complete days
7 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
The LLM Evaluation Framework
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
AI Observability & Evaluation
the LLM vulnerability scanner
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
Open-source simulation harness for testing AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.