Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
- ai
- diagnostic-tool
- agent-evaluation
- ai-alignment
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
An open-source, tool-augmented conversational language model from Fudan University
Framework for evaluating and improving agents
- evals
- rl-environments
- terminal-bench
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
Train and evaluate embeddings for similarity search with PyTorch. Includes contrastive losses, hard example mining, samplers, and retrieval metrics.
Robust recipes to align language models with human and AI preferences
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
Our library for RL environments + evals
Align Anything: Training All-modality Model with Feedback
A live stream development of RL tunning for LLM agents
Inspect: A framework for large language model evaluations
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
Convert HTML to Markdown
See your claude code logs in clear details in your dashboard
Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
BrowserGym, a Gym environment for web task automation
Secrets of RLHF in Large Language Models Part I: PPO
An alignment auditing agent capable of quickly exploring alignment hypothesis
Evaluate and improve models and agents using environments
The repository host gives no description.
A non-saturating, open-ended environment for evaluating LLMs in Factorio
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤