Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
- ai-gateway
- observability
- simulation
- ai-agents
Repository Index
47,133 repositories indexed
49–72 of 112 · Most stars
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
Python audio and music signal processing library
- audio-analysis
- signal-processing
- machine-learning
- music-information-retrieval
Machine learning evaluation metrics, implemented in Python, R, Haskell, and MATLAB / Octave
A tool for quickly evaluating IAM permissions in AWS.
- aws
- iam
- python
- botocore
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
- natural-language-generation
- natural-language-processing
- nlg
- nlp
Toolbox for quantitative trajectory evaluation of VO/VIO
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.
Evaluate OMR sheets fast and accurately using a scanner 🖨 or your phone 🤳.
- opencv
- image-processing
- omr
- omr-sheet
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
allRank is a framework for training learning-to-rank neural models based on PyTorch.
- learning-to-rank
- ndcg
- ranking
- information-retrieval
EdgeRock: Strong Reasoning at Constant Memory. Multimodal models with O(N) generation and O(1) persistent history. Inference and evaluation code.
FactCircuit: an auditable claim-and-evidence verification loop with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.
- accuracy-decline
- ai-safety
- audit-trail
- fact-checking
A code repository indexing tool to supercharge your LLM experience.
- neovim-plugin
- retrieval-augmented
- embeddings
- rag
Clinical Histopathology Imaging Evaluation Foundation Model
Evaluation functions for music/audio information retrieval/signal processing algorithms.
Ontology-Augmented Generation for AI agents.
- agent-skills
- document-parsing
- knowledge-graph
- mineru
A curated list of Monte Carlo tree search papers with implementations.
- tree-search
- learning
- machine-learning
- deep-learning
🔥 The first-ever interactive streaming video generation benchmark.
- avatar-performance
- interaction-streaming-video
- real-time-video-editing
- streaming-video-generation
MCP gateway & OAuth MCP servers. LangGraph agent: memory, eval/tracking, PII guard, context trimming. Docker quick start for enterprise agents.
- agentic-ai
- ai-agents
- context-engineering
- enterprise-ai
Music Structure Analysis Framework
- music-information-retrieval
GLM 5.3 abliterated or uncensored API access with RouterHub. Browse 35 jailbreak prompt links, compare GLM models, and find SDK examples, coding-tool setup, pricing, and evaluation guides.
- abliterated
- abliterated-models
- ai-api
- ai-jailbreaks
:sound: spafe: Simplified Python Audio Features Extraction
Streaming reactive and dataflow graphs in Python
- python
- python3
- stream
- data-pipeline