PyTorch implementation of Audio Flamingo: Series of Advanced Audio Understanding Language Models
- audio-captioning
- audio-language-models
- multimodal-large-language-models
- audio-question-answering
100,822 visible repositories in the index
1–2 of 2 · Most stars
PyTorch implementation of Audio Flamingo: Series of Advanced Audio Understanding Language Models
We introduce the Audio Logical Reasoning (ALR) dataset, consisting of 6,446 text-audio annotated samples specifically designed for complex reasoning tasks. Building on this resource, we propose SoundMind, a rule-based reinforcement learning (RL) algorithm tailored to endow audio language models (ALMs) with deep bimodal reasoning abilities.