[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
- large-language-models
- video-language-pretraining
- vision-language-pretraining
- blip2
Repository Index
73,862 visible repositories in the index
73–96 of 258 · Most stars
Turn audio and video into subtitles with an easy-to-use web UI. Everything runs on your own machine.
Python hands on tutorial with 50+ Python Application (10 lines of code) By @xiaowuc2
- python
- python-application
- python-project
- voice-recorder
[NeurIPS 2025] Let Them Talk: Audio-Driven Multi-Person Conversational Video Generation
Graph-oriented live coding language and music/audio DSP library written in Rust
- rust
- audioworklet
- audio
- web-audio
List of articles related to deep learning applied to music
- awesome
- awesome-list
- unicorns
- list
:musical_note: :rainbow: Real-time LED strip music visualization using Python and the ESP8266 or Raspberry Pi
- raspberry-pi
- music-visualizer
- python
- esp8266
Open-source, self-hosted file-processing tool. Convert, compress, OCR, transcribe & run local AI across image, video, audio, PDF & documents, via UI, REST API & pipelines. Your files never leave your network.
An unofficial PyTorch implementation of the audio LM VALL-E
- vall-e
- valle
- text-to-speech
- pytorch
Data manipulation and transformation for audio signal processing, powered by PyTorch
- audio
- python
- io
- speech
Professional Radio Station App for iOS!
- radio-station
- swift
- audio
- audio-player
AudioLDM: Generate speech, sound effects, music and beyond, with text.
- audio-generation
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
Web extension to set a default speed for video and audio
- speed-controller
- audio-speed
- video-speed
- web-extension
Music Player Daemon
A list of open source audio software projects (Apps, Plugins and Libraries). Please contribute more links or open source your own plugins.
- audio-plugin
- synths
- vst-plugin
Custom elements (web components) for making audio and video player controls that look great in your website or app.
- video
- audio
- video-player
- audio-player
Sampler, Sequencer, Multi-engine synth and effects - in a box! [WIP]
- audio
- raspberry-pi
- ui-design
- synthesizer
A customisable music player
Text-to-Audio/Music Generation
- audio-generation
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
- artificial-intelligence
- attention-mechanisms
- audio-synthesis
- deep-learning
[ICLR 26 Oral] Stable Video Infinity: Infinite-Length Video Generation with Error Recycling
- long-video-generation
- end-to-end-filming
- audio-driven-talking-face
- dance-generation
Support for https://www.gyan.dev/ffmpeg
The PyTorch-based audio source separation toolkit for researchers
- source-separation
- speech-separation
- audio-separation
- speech-enhancement