1.confident-ai / deepevalThe LLM Evaluation Frameworkevaluation-metricsevaluation-frameworkllm-evaluationllm-evaluation-frameworkllm-evaluation-metricspythonPythonAPACHE-2.019K total2.2K forks+657 starsfrom 18,574 · score 6.49
2.EleutherAI / lm-evaluation-harnessA framework for few-shot evaluation of language models.evaluation-frameworklanguage-modeltransformerPythonMIT14K total3.8K forks+246 starsfrom 14,116 · score 5.51
3.future-agi / future-agiOpen-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.ai-gatewayobservabilitysimulationai-agentsai-evalsevaluation-framework+14 morePythonAPACHE-2.02.2K total705 forks+139 starsfrom 2,098 · score 4.94