The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.
Repository Index
47,133 repositories indexed
49–69 of 69 · Most stars
Feather agent harness, training integrations, and evaluation tools for knowledge work
Evidence-aware Japanese speech visualization: pitch and intonation, waveform inspection, and experimental alignment.
OpenBioLink is a resource and evaluation framework for evaluating link prediction models on heterogeneous biomedical graph data.
Evaluation toolbox for Sound Event Detection
DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.
lua code export save to be run on seedsow switch demo exploit
DiscoveryRSI: Recursively Learning to Discover Valuable Hypotheses
A Macau food recommendation Agent built on Thompson Sampling + StackedPareto weight fusion, with a full evaluation pipeline (5-fold CV, bootstrap CIs, stress tests) on 5,000 simulated users and 100k interactions. Competition entry for the QwenPaw AI Developer Challenge.
GLM 5.3 Uncensored — 35 jailbreak prompt files, model guide and API access. One RouterHub key also covers GPT, Claude, DeepSeek, Qwen and Grok.
Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents
An ESLint plugin for Neovim, using VSCode ESLint LSP and native nvim LSP client
IQM & EXM model format specs, Blender exporter, and LÖVE loader.
Test harness for voice agents. Import from Retell, VAPI, Bland, LiveKit. Run autonomous simulations. Evaluate with LLM judges.
⚡ JEval helps you to evaluate your JMeter test plan and provides recommendation before you start your performance testing. All contributions welcome 🙏.
HistoClean is a tool for the preprocessing and augmentation of images used in deep learning models. This easy to use application brings together the most popular image processing packages from across the python universe, meaning no more looking at documentation! HistoClean provides real time feedback to augmentations and preprocessing options. This allows users to evaluate their steps before implementation.
Too lazy for write "pip install -r requirements.txt", or "cargo add ...".. or maybe.. "luarocks install .." and writing it to requirements file? This plugin for you!
Evaluation of packer type estimation/detection tools
Code and data for the paper "Evaluating German Transformer Language Models with Syntactic Agreement Tests" (Zaczynska et al., 2020)
Open-source simulation harness for testing AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.
Machine learning model evaluation made easy: plots, tables, HTML reports, experiment tracking and Jupyter notebook analysis.