The LLM Evaluation Framework
- evaluation-metrics
- evaluation-framework
- llm-evaluation
- llm-evaluation-framework
Repository Index
47,133 repositories indexed
1–13 of 13 · Most stars
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
A collection of libraries to optimise AI model performances
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
- natural-language-generation
- natural-language-processing
- nlg
- nlp
Cut AI context cost without trusting the compressor. Every reduction is reversible, byte-exact recoverable, and carries an auditable receipt. Local-first, works through proxy, MCP, SDK, or agent wrapper.
- ai-agents
- claude-code
- mcp
- token-optimization
The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.
- ai-agents
- benchmark
- coding-agents
- embodied-ai
The World's Most Comprehensive, Authoritative, and Structured Open Source Data Source Knowledge Base
- mcp
- data-sources
- ai
- awesome-list
Official implementation of paper "Cache Engineering for Agents"
Safety in Embodied AI: A Survey of Risks, Attacks, and Defenses | 500+ Papers | Perception, Cognition, Planning, Interaction, Agentic System
- adversarial-attacks
- ai-safety
- autonomous-driving
- backdoor-attacks
CASSIA: A Multi-Agent LLM-Based Single-Cell Cell Type Annotation Framework
- ai4science
- llm
- multiagent-systems
- prompt-engineering
Datalogger for MicroPython and CPython.
- micropython
- datalogger
- esp32
- mqtt
Autonomous multi-agent framework to optimize scientific software
- acceleration
- agentic-ai
- ai-agents
- bioinformatics
MCP server for spatial transcriptomics analysis through natural language interfaces.
- bioinformatics
- cell-communication
- deconvolution
- machine-learning