Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
Repository Index
57,637 visible repositories in the index
241–264 of 542 · Most stars
🐢 Open-Source Evaluation & Testing library for LLM Agents
- mlops
- ml-validation
- ml-testing
- ai-testing
Democratizing Reinforcement Learning for LLMs
- agent-framework
- agentic-workflow
- distributed-training
- llm-training
The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.
- llm
- llm-reasoning
- machine-learning-systems
- mlsys
A language model programming library.
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
- llava
- llm
- mlx
- vision-transformer
⚡️ OpenAI PHP is a supercharged community-maintained PHP API client that allows you to interact with OpenAI API.
🛰️ Track token usage across AI coding agents from your terminal. 🏅 Global leaderboard with trillions of tokens tracked.
- claude
- claude-code
- codex
- cursor
Enterprise-grade AI agent framework with multi-provider LLM management, secure knowledge bases and high-precision RAG, visual workflow orchestration, and multi-agent coordination.
A visual playground for agentic workflows: Iterate over your agents 10x faster
Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.
Context Graph for AI Native SDLC
TranslatedGemini polling proxy service
- gemini
- gemini-api
- googlesearch
- imagen-3
[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org
OpenClaw-RL: Train any agent simply by talking
- async
- memory-systems
- open-claw
- openclaw-skills
Robust recipes to align language models with human and AI preferences
- llm
- rlhf
- transformers
⚒ Evolutionary self-improvement for Hermes Agent — optimize skills, prompts, and code using DSPy + GEPA
Your Personal Librarian Agent. Ask anything on your computer, organize files, remember important info and files.
- document-parser
- embeddings
- llm
- open-source
A large-scale 7B pretraining language model developed by BaiChuan-Inc.
RLinf: Reinforcement Learning Infrastructure for Embodied and Agentic AI
- reinforcement-learning
- agentic-ai
- rlinf
- vla-rl
Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.
- agentic-coding
- ai-gateway
- anthropic
- claude-code
Chat first code editor. To download the packaged app:
⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.