LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Repository Index
73,362 visible repositories in the index
1–24 of 50 · Most stars
Easily train a good VC model with voice data <= 10 mins!
- change
- sovits
- vits
- voice
Cross-platform, customizable ML solutions for live and streaming media.
- mediapipe
- c-plus-plus
- computer-vision
- deep-learning
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
- audio-generation
- gpt-4o
- text-to-speech
- tts
CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.
- video-annotation
- computer-vision
- computer-vision-annotation
- image-annotation
[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
- audio-driven-talking-face
- cvpr2023
- talking-head
- deep-fake
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
- foundation-models
- music-generation
- huggingface
- llama
A PyTorch-based Speech Toolkit
- speech-recognition
- speech-toolkit
- speaker-recognition
- speech-to-text
Download video and audio from 1000+ sites, transcribe locally with speaker labels, and summarize, translate, or chat with your media using your preferred AI provider.
- downloader
- tiktok
Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.
- audio-generation
- audio-synthesis
- audioldm
- music-generation
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
- asr
- speech-recognition
- speech-to-text
- cross-lingual
Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation
- face-animation
- image-animation
- video-animation
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
- apple-silicon
- audio-processing
- mlx
- multimodal
A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch
[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
- lip-synchronization
- talking-head-videos
- video-editing
- siggraph-asia-2022
TranslatedA tool focused on AI multimodal translation that automatically translates, with one click, RPG/SLG games, Epub/TXT novels, PDF/Word/MD documents, Srt/Ass/Vtt subtitles, as well as manga images, audio, video, and more.
- ai-translator
- audio-transcription
- document-translation
- epub-translator
A lightweight yet powerful audio-to-MIDI converter with pitch bend detection
- lightweight
- machine-learning
- midi
- music
AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
[CVPR 2025] EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation
- audio-driven-portrait-animations
- audio-driven-talking-face
- human-animation
- talking-face-generation
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
- chinese
- english
- multilingual
- realtime
[AAAI 2025] EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning
- audio-driven-talking-face
- talking-head
- audio-driven-portrait-animations
- talking-face-generation
An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS
[ICLR 2025] Hallo2: Long-Duration and High-Resolution Audio-driven Portrait Image Animation
A single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet, AudioGen, MusicGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, and Bark!
- gradio
- text-to-speech
- tts
- ai