Easily train a good VC model with voice data <= 10 mins!
- change
- sovits
- vits
- voice
Repository Index
73,362 visible repositories in the index
1–24 of 74 · Most stars
Deezer source separation library including pretrained models.
- deezer
- python
- tensorflow
- audio-processing
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
- audio-generation
- gpt-4o
- text-to-speech
- tts
CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.
- video-annotation
- computer-vision
- computer-vision-annotation
- image-annotation
[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
- audio-driven-talking-face
- cvpr2023
- talking-head
- deep-fake
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
- foundation-models
- music-generation
- huggingface
- llama
A PyTorch-based Speech Toolkit
- speech-recognition
- speech-toolkit
- speaker-recognition
- speech-to-text
Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.
- audio-generation
- audio-synthesis
- audioldm
- music-generation
Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation
- face-animation
- image-animation
- video-animation
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
- apple-silicon
- audio-processing
- mlx
- multimodal
A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch
[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
- lip-synchronization
- talking-head-videos
- video-editing
- siggraph-asia-2022
TranslatedA tool focused on AI multimodal translation that automatically translates, with one click, RPG/SLG games, Epub/TXT novels, PDF/Word/MD documents, Srt/Ass/Vtt subtitles, as well as manga images, audio, video, and more.
- ai-translator
- audio-transcription
- document-translation
- epub-translator
Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications
- audio
- machine-learning
- signal-processing
- audio-data
A lightweight yet powerful audio-to-MIDI converter with pitch bend detection
- lightweight
- machine-learning
- midi
- music
Local video editor for coding agents: 42 FFmpeg tools with a machine-readable contract and an MCP server, for Claude Code, Cursor and Codex. Cut, captions, reframe, loudness, platform exports. No cloud, no API keys.
AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
[CVPR 2025] EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation
- audio-driven-portrait-animations
- audio-driven-talking-face
- human-animation
- talking-face-generation
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
- chinese
- english
- multilingual
- realtime
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
- agi
- evaluation
- large-language-models
- multimodal
[AAAI 2025] EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning
- audio-driven-talking-face
- talking-head
- audio-driven-portrait-animations
- talking-face-generation
An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS
Generative models for conditional audio generation
[ICLR 2025] Hallo2: Long-Duration and High-Resolution Audio-driven Portrait Image Animation