One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
- agi
- evaluation
- large-language-models
- multimodal
111,820 visible repositories in the index
1–8 of 8 · Most stars
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
A fork to add multimodal model training to open-r1
[arXiv 2023] Set-of-Mark Prompting for GPT-4V and LMMs
Fully Open Framework for Democratized Multimodal Training
NEO Series: Native Vision-Language Models from First Principles
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)