Ranked by Attention Score: stars gained over the last 180 complete days
8 repositories by Attention Score · May 9, 2026 – Nov 4, 2026 (UTC)
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
A framework for few-shot evaluation of language models.
Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).
LLM and agent evaluation for Java & Kotlin. Runs in JUnit and CI. Spring AI, LangChain4j, Koog, Embabel, and any LLM client.
The E2E AI testing tool | No ML Overhead
Ideas, tricks, materials with puzzles for AIs and some wetware