The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
Machine learning evaluation metrics, implemented in Python, R, Haskell, and MATLAB / Octave
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).
A curated list of Monte Carlo tree search papers with implementations.
🍇 GRAPE is a Rust/Python Graph Representation Learning library for Predictions and Evaluations
Deploy tensorflow graphs for fast evaluation and export to tensorflow-less environments running numpy.
A 4B grounding foundation model for physical intelligence. Unifies detection, referring, pointing, OCR, GUI, and layout grounding, achieving SOTA overall across 34 benchmarks and improving robot generalization and data efficiency in controlled evaluations.
ROS package for the Perception (Sensor Processing, Detection, Tracking and Evaluation) of the KITTI Vision Benchmark Suite
- ros
- ros-kinetic
- ros-packages
- rviz
Evidence-aware Japanese speech visualization: pitch and intonation, waveform inspection, and experimental alignment.
- audio-processing
- fastapi
- japanese
- librosa
A Macau food recommendation Agent built on Thompson Sampling + StackedPareto weight fusion, with a full evaluation pipeline (5-fold CV, bootstrap CIs, stress tests) on 5,000 simulated users and 100k interactions. Competition entry for the QwenPaw AI Developer Challenge.
The E2E AI testing tool | No ML Overhead
- ai
- rag
- rag-evaluation
- rag-pipeline
Machine learning model evaluation made easy: plots, tables, HTML reports, experiment tracking and Jupyter notebook analysis.