A framework for few-shot evaluation of language models.
- evaluation-framework
- language-model
- transformer
47,133 repositories indexed
1–7 of 7 · Most stars
A framework for few-shot evaluation of language models.
Scikit-learn for Recursive Self-improvement (RSI). A modular framework for recursive harness evolution.
Feather agent harness, training integrations, and evaluation tools for knowledge work
Evolved DSH plugin harnesses for five agent benchmarks, with versioned artifacts, evolution curves and Life-Harness comparisons
Test harness for voice agents. Import from Retell, VAPI, Bland, LiveKit. Run autonomous simulations. Evaluate with LLM judges.
Open-source simulation harness for testing AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.
Framework-agnostic evaluation harness for Go — test your MCP servers and AI agents with scored, CI-ready checks.