1.confident-ai / deepevalThe LLM Evaluation Frameworkevaluation-metricsevaluation-frameworkllm-evaluationllm-evaluation-frameworkllm-evaluation-metricspythonPythonAPACHE-2.019K total2.2K forks+1,891 starsfrom 17,340 · score 7.55
2.EleutherAI / lm-evaluation-harnessA framework for few-shot evaluation of language models.evaluation-frameworklanguage-modeltransformerPythonMIT14K total3.8K forks+864 starsfrom 13,498 · score 6.76
3.future-agi / future-agiOpen-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.ai-gatewayobservabilitysimulationai-agentsai-evalsevaluation-framework+14 morePythonAPACHE-2.02.2K total705 forks+666 starsfrom 1,571 · score 6.50