[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Repository Index
111,821 visible repositories in the index
1–24 of 46 · Most stars
A TTS model capable of generating ultra-realistic dialogue in one pass.
- ai
- open-weight
- text-to-speech
Real-Time SLAM for Monocular, Stereo and RGB-D Cameras, with Loop Detection and Relocalization Capabilities
[NeurIPS 2024] Depth Anything V2. A More Capable Foundation Model for Monocular Depth Estimation
- monocular-depth-estimation
A python library built to empower developers to build applications and systems with self-contained Computer Vision capabilities
- artificial-intelligence
- machine-learning
- prediction
- image-prediction
Qwen-Image is a powerful image generation foundation model capable of complex text rendering and precise image editing.
TranslatedOffline translation model server with low resource consumption, fast speed, and private deployment capability.
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
- deep-learning
- mnn
- ncnn
- inference
LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2609.17488
- foundation-models
- limix
- machine-learning
- structured-data
Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, images, and video, as well as generating speech in real time.
Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and performing real-time speech generation.
open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.
pySLAM is a hybrid Python/C++ Visual SLAM pipeline supporting monocular, stereo, and RGB-D cameras. It provides a broad set of modern local and global feature extractors, multiple loop-closure strategies, a volumetric reconstruction module, integrated depth-prediction models, and semantic segmentation capabilities for enhanced scene understanding.
- 3d-reconstruction
- depth-prediction
- feature-matching
- global-features
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
- large-language-models
- multimodal-large-language-models
- speech-language-model
- speech-to-speech
🎙️ A 0.1B Omni model trained from scratch, capable of listening, speaking, and seeing!
[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.
⚠️DirectML is in maintenance mode ⚠️ DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning. DirectML provides GPU acceleration for common machine learning tasks across a broad range of supported hardware and drivers, including all DirectX 12-capable GPUs from vendors such as AMD, Intel, NVIDIA, and Qualcomm.
a generalist algorithm for cellular segmentation with human-in-the-loop capabilities
- segmentation
- cell-segmentation
- cell-biology
Open-source industrial-grade ASR models supporting Mandarin, Chinese dialects and English, achieving a new SOTA on public Mandarin ASR benchmarks, while also offering outstanding singing lyrics recognition capability.
- asr
- industrial-grade
- llm
- multimodal-llm
WhisperPlus: Faster, Smarter, and More Capable 🚀
An Embedded Computer Vision & Machine Learning Library (CPU Optimized & IoT Capable)
A complete video subtitle editing React component with AI-powered speech recognition and visual editing capabilities.
WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
bsuite is a collection of carefully-designed experiments that investigate core capabilities of a reinforcement learning (RL) agent