A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
Repository Index
75,859 visible repositories in the index
25–48 of 64 · Most stars
Mirix is a multi-agent personal assistant designed to track on-screen activities and answer user questions intelligently. By capturing real-time visual data and consolidating it into structured memories, Mirix transforms raw inputs into a rich knowledge base that adapts to your digital experiences.
- llm-agents
- llm-memory
- memory-agents
- personal-assistant
Open-source, self-hosted AI penetration testing framework: maps your attack surface into a graph, autonomously exploits it from a Kali sandbox with human approval gates, and opens PRs that fix what it finds. MCP both ways: plug in any MCP server as a tool, or drive RedAmon from Claude Code or your own agent.
- ai-pentesting
- autonomous-agents
- bug-bounty
- kali-linux
A blueprint-driven AutoResearch runtime for orchestrating AI research workflows from idea generation and experiments to paper writing and peer review.
- agentic-workflow
- ai-scientist
- automated-research
- autoresearch
Agent RL framework for LLM agents: multi-turn reinforcement learning with StarPO and reasoning-collapse diagnostics
- agent-rl
- agentic-ai
- llm-agents
- reinforcement-learning
Structured deep research skill for Claude Code/Open Code/Codex with human-in-the-loop control
- claude-code
- claude-code-skills
- deep-research-agent
- llm-agent
verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in-Group Policy Optimization for LLM Agent Training"
- llm-agents
- llm-training
- reinforcement-learning
- large-language-models
AssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for Industry 4.0 asset operations and maintenance, with 460+ scenarios, 5 specialist agents (IoT, FMSR, TSFM, Work Order,...), and multi-agent orchestration blueprints (MetaAgent, AgentHive) over MCP.
- llm-agents
- model-context-protocol
- time-series-forecasting
- condition-based-maintenance
A repo lists papers related to LLM based agent
- agents
- large-language-models
- llm-agent
- paper-list
No-code multi-agent framework to build LLM Agents, workflows and applications with your data
- ai
- generative-ai
- llm-chain
- llm-framework
Python trading framework with AI agents that actually place the trade. Backtest, paper and live trade on 12 brokers: stocks, options, futures, forex, crypto and prediction markets.
[EMNLP2026] "VideoAgent: All-in-One Agentic Framework for Video Understanding and Editing, and Remaking"
- agents
- llm-agents
- video-editing
- video-understanding
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
- function-calling
- llm
- llm-agent
- llm-agents
An auto-evolution framework that optimizes anything — your 7×24 team of algorithm engineers.
- evolutionary-algorithms
- rsi-ai
- self-improvement
- llm-agent
TranslatedEvoOntology: A Self-Evolving Ontology Layer for Data Agents ⚙️ The EvoOntology plugin builds and evolves an ontology layer for Claude Code/Codex
The foundation layer for agentic intelligence.
Open, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.
- agent-evaluation
- agentic-ai
- ai-agents
- awesome
Remory: Learning Residual Memory for Context Compaction
- context-compaction
- inference
- llm-agents
- residual-memory
Oracle3: open-source trading engine and MCP server for prediction markets. Finds fee-adjusted no-arbitrage violations across related event contracts and trades them live on Kalshi, Polymarket and Solana, or on paper, under pre-trade risk limits. 13 MCP tools, JSON CLI, agent skills, 600+ tests.
- algorithmic-trading
- kalshi
- polymarket
- python
The repository host gives no description.
🔥🔥 The extremely fast inference engine for decision model
- gemma
- inference-engine
- llm-inference
- llm-serving
Official Code for OpenVLHarness: Real-World Visual Agentic Tool‑Use with Multimodal Memory
- agent-harness
- agentic-ai
- ai-agents
- coding-agent
OPAL: a reactive optimizer. A coding agent rewrites the optimizer while your model trains.
- deep-learning
- llm-agents
- optimizer
- pytorch
An agent that compiles git maintenance chores into reusable programs, then decides whether to replay them by running checks rather than by guessing the task looks familiar
- agent-architecture
- git-automation
- llm-agents
- program-synthesis