1.Folkbench / folkbench
TranslatedOpen-source AI API relay benchmark, rankings & switcher for Claude Code / Codex: measured availability, latency and price
+4,332 stars
from 1 · score 8.37
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
7 repositories by Attention Score · Oct 7, 2026 – Nov 5, 2026 (UTC)
2.langfuse / langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
- analytics
- llm
- llmops
- large-language-models
- openai
- self-hosted
- +13 more
+1,693 stars
from 35,374 · score 7.43
3.xinxuxin / keystone-bench
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
+575 stars
from 557 · score 6.36
4.Arize-ai / phoenix
AI Observability & Evaluation
- llmops
- ai-monitoring
- ai-observability
- llm-eval
- aiengineering
- datasets
- +10 more
+447 stars
from 11,718 · score 6.10
5.facebookresearch / swe-sweep
How many bugs can LMs find & fix in large codebases?
- ai
- ai-agents
- benchmark
- benchmarking
- harbor
- harbor-framework
- +5 more
+169 stars
from 54 · score 5.14
6.openai / evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
+160 stars
from 19,550 · score 5.08
7.ConardLi / easy-dataset
A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
- dataset
- javascript
- llm
- fine-tuning
- rag
+128 stars
from 14,958 · score 4.86