Trending repositories

Ranked by Attention Score: stars gained over the last 90 complete days

Period

Sort order

Tags: LLM evaluation

1.langfuse / langfuse

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

analytics
llm
llmops
large-language-models
openai
self-hosted
+13 more

TypeScript Other license37K total4.2K forks

+4,552 stars

from 32,515 · score 8.42

2.Arize-ai / phoenix

AI Observability & Evaluation

llmops
ai-monitoring
ai-observability
llm-eval
aiengineering
datasets
+10 more

Python Other license12K total1.3K forks

+1,286 stars

from 10,879 · score 7.16

3.openai / evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Python Other license20K total3.1K forks

+633 stars

from 19,077 · score 6.45

4.ConardLi / easy-dataset

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

dataset
javascript
llm
fine-tuning
rag

JavaScript Other license15K total1.5K forks

+396 stars

from 14,690 · score 5.98

5.Maluuba / nlg-eval

Evaluation code for various unsupervised automated metrics for Natural Language Generation.

natural-language-generation
natural-language-processing
nlg
nlp
evaluation
bleu
+11 more

Python Other license1.4K total224 forks

+2 stars

from 1,390 · score 1.10

Order: Attention Score

Most net stars gained in the window first. The score only puts this gain on a log scale, so the order is the order of the gain.

How the ranking works

Ranked by stars gained in the window. The score is the natural log of one plus that gain, so a repository's rank is exactly its star gain's rank.

score = log1p(net stars gained in the trailing T complete UTC days)

A repository is ranked only when its Star History covers every day of the window and its latest Observation is not missing.

The longest window is 180 days. Star History from the Repository Host goes back at most 180 days before the first daily record that AwesomeRepos made for the repository. A longer window needs more of these daily records first. A repository younger than the window does not rank in it.

The filters select from the same eligible repositories. A repository matches the topics when it has any of them. Total stars is the count now. Last push and creation on the Repository Host count back from the start of today (UTC). The counts beside the languages, licenses, and topics include all ranked repositories in the window. A Tag holds the repositories that have it. See Tags.

A new repository enters the index when it gains stars faster than the published admission threshold, whatever its size. A repository stays in the index after it enters. Thus an archived repository can still rank.

Browse the Repository Index