🐢 Open-Source Evaluation & Testing library for LLM Agents
- mlops
- ml-validation
- ml-testing
- ai-testing
132,241 visible repositories in the index
1–9 of 9 · Most stars
🐢 Open-Source Evaluation & Testing library for LLM Agents
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
Lifecycle-Aware Memory for long-horizon LLM agents — 66.05% on PaperBench, 94.66% on SurveyBench, 10 peer-reviewed acceptances at FSE/ICML/TOSEM/AEI/ICoGB
The repository host gives no description.
[EMNLP 2024 Demo] MarkLLM: An Open-Source Toolkit for LLM Watermarking
AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.
NISQA - Non-Intrusive Speech Quality and TTS Naturalness Assessment
TavernGym and TavernBench: a faithful, full-content Hearthstone Battlegrounds simulator with an RL interface, and a 960-task decision benchmark. Code and data for "Build, Don't Play".
Catch your AI agents when they lie about what they shipped — verifies claims against git instead of believing the agent.