[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
- large-language-models
- video-language-pretraining
- vision-language-pretraining
- blip2
Repository Index
73,862 visible repositories in the index
25–48 of 74 · Most stars
Python hands on tutorial with 50+ Python Application (10 lines of code) By @xiaowuc2
- python
- python-application
- python-project
- voice-recorder
[NeurIPS 2025] Let Them Talk: Audio-Driven Multi-Person Conversational Video Generation
:musical_note: :rainbow: Real-time LED strip music visualization using Python and the ESP8266 or Raspberry Pi
- raspberry-pi
- music-visualizer
- python
- esp8266
An unofficial PyTorch implementation of the audio LM VALL-E
- vall-e
- valle
- text-to-speech
- pytorch
Data manipulation and transformation for audio signal processing, powered by PyTorch
- audio
- python
- io
- speech
AudioLDM: Generate speech, sound effects, music and beyond, with text.
- audio-generation
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
Text-to-Audio/Music Generation
- audio-generation
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
- artificial-intelligence
- attention-mechanisms
- audio-synthesis
- deep-learning
[ICLR 26 Oral] Stable Video Infinity: Infinite-Length Video Generation with Error Recycling
- long-video-generation
- end-to-end-filming
- audio-driven-talking-face
- dance-generation
The PyTorch-based audio source separation toolkit for researchers
- source-separation
- speech-separation
- audio-separation
- speech-enhancement
[ECCV 2026 Spotlight] Implementation of "Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length"
The collection of pre-trained, state-of-the-art AI models for ailia SDK
- deep-learning
- face-recognition
- face-detection
- object-detection
A Python library for audio data augmentation. Useful for making audio ML models work well in the real world, not just in the lab.
[CVPR 2025] MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis
- audio
- audio-synthesis
- computer-vision
- deep-learning
Cutting edge AI technology for automated audio transcription. A nice GUI for OpenAIs Whisper and pyannote (speaker identification)
- audio-transcription
- interview
- pyannote
- qualitative-research
LedFx is a network based LED effect engine designed to deliver advanced real-time audio effects to a wide variety of devices.
- python
- music-visualizer
- audio-processing
- qlc
Audio generation using diffusion models, in PyTorch.
- artificial-intelligence
- audio-generation
- deep-learning
- denoising-diffusion
JoyAI-Echo-1.5: Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds
[EMNLP2026] "VideoAgent: All-in-One Agentic Framework for Video Understanding and Editing, and Remaking"
- agents
- llm-agents
- video-editing
- video-understanding
:unlock: Lip Reading - Cross Audio-Visual Recognition using 3D Architectures
- deep-learning
- computer-vision
- speech-recognition
- 3d-convolutional-network
Python audio and music signal processing library
- audio-analysis
- signal-processing
- machine-learning
- music-information-retrieval
This repository will be used to develop a rain generator, actually it use white noises to simulate wind and have an integrated thunderstorm simulator.
- asmr
- audio-generator
- rainfall
- thunderbolt