Lightweight (7MB) terminal-first AI-native development environment
Repository Index
69,734 visible repositories in the index
1–11 of 11 · Most stars
Framework for evaluating and improving agents
- evals
- rl-environments
- terminal-bench
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
Our library for RL environments + evals
The open-source visual AI programming environment and TypeScript library
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
- agent
- artificial-intelligence
- benchmark
- multimodal
An open-source visual programming environment for battle-testing prompts to LLMs.
- ai
- evaluation
- large-language-models
- llmops
The open-source policy-as-code software that provides analysis for Multi-Cloud and SaaS environments, you can get insight with natural language (powered by OpenAI).
This is the official repo for paper InteractiveWorld A Verifiable Human-Centric Environment for Building Better Interactive MLLM Assistants
Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents
A ChatGPT-based tool to decode Jupyter notebooks and the similar python notebook environments like Google Colab, etc.