🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 41 · Most stars
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
- audio
- deeplearning
- minicpm
- python
A generative speech model for daily dialogue.
Easily train a good VC model with voice data <= 10 mins!
- change
- sovits
- vits
- voice
Instant voice cloning by MIT and MyShell. Audio foundation model.
- text-to-speech
- tts
- voice-clone
- zero-shot-tts
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
- deep-learning
- diffusion
- image-generation
- pytorch
SOTA Open Source TTS
- llama
- transformer
- tts
- valle
GUI for a Vocal Remover that uses Deep Neural Networks.
- vocal-remover
- pytorch
- source
- separation
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
- audio-generation
- gpt-4o
- text-to-speech
- tts
Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
- pytorch
- speech-recognition
- paraformer
- punctuation
Generate audiobooks from e-books, 50+ TTS engines with voice cloning and 1696 languages!
CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.
- video-annotation
- computer-vision
- computer-vision-annotation
- image-annotation
[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
- audio-driven-talking-face
- cvpr2023
- talking-head
- deep-fake
Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.
A PyTorch-based Speech Toolkit
- speech-recognition
- speech-toolkit
- speaker-recognition
- speech-to-text
Spark-TTS Inference Code
Speech recognition module for Python, supporting several engines and APIs, online and offline.
Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications
- audio
- machine-learning
- signal-processing
- audio-data
Data manipulation and transformation for audio signal processing, powered by PyTorch
- audio
- python
- io
- speech
aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
- speech
- alignment
- tts
- python
SOTA-Class TTS at Compact Scale
A Python library for audio data augmentation. Useful for making audio ML models work well in the real world, not just in the lab.
:unlock: Lip Reading - Cross Audio-Visual Recognition using 3D Architectures
- deep-learning
- computer-vision
- speech-recognition
- 3d-convolutional-network