🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 58 · Most stars
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
- audio
- deeplearning
- minicpm
- python
A generative speech model for daily dialogue.
🔊 Text-Prompted Generative Audio Model
Easily train a good VC model with voice data <= 10 mins!
- change
- sovits
- vits
- voice
Instant voice cloning by MIT and MyShell. Audio foundation model.
- text-to-speech
- tts
- voice-clone
- zero-shot-tts
Cross-platform, customizable ML solutions for live and streaming media.
- mediapipe
- c-plus-plus
- computer-vision
- deep-learning
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
- deep-learning
- diffusion
- image-generation
- pytorch
SOTA Open Source TTS
- llama
- transformer
- tts
- valle
GUI for a Vocal Remover that uses Deep Neural Networks.
- vocal-remover
- pytorch
- source
- separation
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
- audio-generation
- gpt-4o
- text-to-speech
- tts
Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
- pytorch
- speech-recognition
- paraformer
- punctuation
Generate audiobooks from e-books, 50+ TTS engines with voice cloning and 1696 languages!
CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.
- video-annotation
- computer-vision
- computer-vision-annotation
- image-annotation
[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
- audio-driven-talking-face
- cvpr2023
- talking-head
- deep-fake
Formerly KrillinAI, VideoTranslation and Dubbing Tool for 120+ Languages. Open-source AI workspace for creators, powered by Codex. Video downloader, video translation, create videos, images, audios, and edits with Agents in one place. For your Social Media like YouTube, TikTok, Instagram, etc.
- video-transcription
- video-translation
- dubbing
- localization
Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.
A PyTorch-based Speech Toolkit
- speech-recognition
- speech-toolkit
- speaker-recognition
- speech-to-text
Spark-TTS Inference Code
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
Speech recognition module for Python, supporting several engines and APIs, online and offline.
Translated词光 (Ciguang, "word light") · Word Atlas — Illustrated IELTS vocabulary with 7,298 words, UK/US audio and FSRS review. Open-source app + CC BY 4.0 dataset.
- chinese
- dataset
- english-learning
- flashcards
Frontier CoreML audio models in your apps — text-to-speech, speech-to-text, voice activity detection, and speaker diarization. In Swift, powered by SOTA open source.