83,586 visible repositories in the index
1–24 of 56 · Most stars
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
the LLM vulnerability scanner
"ClawWork: OpenClaw as Your AI Coworker - 💰 $15K earned in 11 Hours"
This repo powers my experiment where ChatGPT manages a real-money micro-cap stock portfolio.
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
Paper2Code: Automating Code Generation from Scientific Papers in Machine Learning
Our library for RL environments + evals
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
TranslatedChinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
🐧 Unified and Stable RSI Platform
Same agent Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.
Find, benchmark and install in CLI 170+ FREE coding LLM models across 15+ providers in real time
Formal verification for AI: a Lean 4 + Dafny proof checker that catches fake AI proofs (reward hacking), and verified recursive self-improvement (RSI) for coding agents. AI for math, physics and software engineering.
An open-source Harness Engineering platform for coding agents—define harnesses as code, run controlled experiments, inspect evidence, and compare outcomes. Turn task evidence into actionable team and organization insights.
τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
Automatic Video Generation from Scientific Papers
Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
[CVPR 2025] A Comprehensive Benchmark for Document Parsing and Evaluation
ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.
A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.
Simulate Before Reality.