🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 37 · Most stars
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
- audio
- deeplearning
- minicpm
- python
A generative speech model for daily dialogue.
Easily train a good VC model with voice data <= 10 mins!
- change
- sovits
- vits
- voice
Instant voice cloning by MIT and MyShell. Audio foundation model.
- text-to-speech
- tts
- voice-clone
- zero-shot-tts
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
- deep-learning
- diffusion
- image-generation
- pytorch
SOTA Open Source TTS
- llama
- transformer
- tts
- valle
GUI for a Vocal Remover that uses Deep Neural Networks.
- vocal-remover
- pytorch
- source
- separation
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
- audio-generation
- gpt-4o
- text-to-speech
- tts
Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
- pytorch
- speech-recognition
- paraformer
- punctuation
Generate audiobooks from e-books, 50+ TTS engines with voice cloning and 1696 languages!
CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.
- video-annotation
- computer-vision
- computer-vision-annotation
- image-annotation
[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
- audio-driven-talking-face
- cvpr2023
- talking-head
- deep-fake
Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.
A PyTorch-based Speech Toolkit
- speech-recognition
- speech-toolkit
- speaker-recognition
- speech-to-text
Spark-TTS Inference Code
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
Speech recognition module for Python, supporting several engines and APIs, online and offline.
SOTA-Class TTS at Compact Scale
:unlock: Lip Reading - Cross Audio-Visual Recognition using 3D Architectures
- deep-learning
- computer-vision
- speech-recognition
- 3d-convolutional-network
BirdNET analyzer for scientific audio data processing.
- bioacoustics
- birds
- birdsong
- acoustic-monitoring
We propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K.
- diffusion-models
- high-resolution
- sparse-attention
- video-generation
Open-source AI video replacement workflow by TEIN. Combine depth maps, SAM segmentation, face meshes, and audio processing to replace characters and objects with Seedance. Includes a local web UI to prepare inputs, review masks, preview generations, and export with original audio.