Sign in

Repository Index

100,822 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters

Filters

Clear all filters

1–2 of 2 · Most stars

PyTorch implementation of Audio Flamingo: Series of Advanced Audio Understanding Language Models

  • audio-captioning
  • audio-language-models
  • multimodal-large-language-models
  • audio-question-answering

We introduce the Audio Logical Reasoning (ALR) dataset, consisting of 6,446 text-audio annotated samples specifically designed for complex reasoning tasks. Building on this resource, we propose SoundMind, a rule-based reinforcement learning (RL) algorithm tailored to endow audio language models (ALMs) with deep bimodal reasoning abilities.