Janus-Series: Unified Multimodal Understanding and Generation Models
- any-to-any
- foundation-models
- llm
- multimodal
Repository Index
47,133 repositories indexed
1–10 of 10 · Most stars
A PyTorch-based Speech Toolkit
- speech-recognition
- speech-toolkit
- speaker-recognition
- speech-to-text
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
Implementation of Nougat Neural Optical Understanding for Academic Documents
pySLAM is a hybrid Python/C++ Visual SLAM pipeline supporting monocular, stereo, and RGB-D cameras. It provides a broad set of modern local and global feature extractors, multiple loop-closure strategies, a volumetric reconstruction module, integrated depth-prediction models, and semantic segmentation capabilities for enhanced scene understanding.
- 3d-reconstruction
- depth-prediction
- feature-matching
- global-features
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
Powerful Markdown package for Sublime Text with better syntax understanding and good color schemes.
This Word Does Not Exist
On-device Vision Model - a fully offline, free vision pipeline that gives text-only models (e.g. DeepSeek) image understanding and multilingual OCR through an OpenAI-compatible local API. Only tokens are needed: no API key, no subscription, no cloud cost. Recommended for native speakers of Chinese, English, Japanese and Korean.
Detect the sentiment captured in short pieces of text
- docker-image
- machine-learning
- machine-learning-models
- ibm