Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.
Feather agent harness, training integrations, and evaluation tools for knowledge work
Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents