[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Repository Index
47,133 repositories indexed
1–7 of 7 · Most stars
Janus-Series: Unified Multimodal Understanding and Generation Models
- any-to-any
- foundation-models
- llm
- multimodal
[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
- object-detection
- open-world
- open-world-detection
- vision-language
Translated[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. An open-source multimodal dialogue model with performance close to GPT-4o
- image-classification
- image-text-retrieval
- llm
- semantic-segmentation
Vision-Language Pathology Foundation Model - Nature Medicine
- bioimage-analysis
- bioimage-informatics
- conch
- foundation-model
A 4B grounding foundation model for physical intelligence. Unifies detection, referring, pointing, OCR, GUI, and layout grounding, achieving SOTA overall across 34 benchmarks and improving robot generalization and data efficiency in controlled evaluations.
- embodied-ai
- gui-grounding
- object-detection
- ocr
Official code for "Reinforcement Fine-Tuning of Flow-Matching Policies for Vision-Language-Action Models" (ICRA 2026): Flow Policy Optimization for pi0
- aloha
- flow-matching
- icra2026
- jax