Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
Repository Index
82,088 visible repositories in the index
265–288 of 819 · Most stars
Learn how to design large-scale systems. Prep for the system design interview.
- architecture
- interview
- design
- design-patterns
StarGAN v2 - Official PyTorch Implementation (CVPR 2020)
- pytorch
- image-to-image-translation
- generative-models
- stargan-v2
⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
[NeurIPS 2026] DataFlex: A Unified Benchmark and Evaluation Platform for Data-Centric Training of Large Language Models
- data-mixture
- data-science
- data-selection
- data-reweighting
open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.
Quickly and accurately render even the largest data.
- holoviz
- datashader
- data-visualizations
- rasterization
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
- graph-attention-networks
- attention-mechanism
- self-attention
- tensorflow
Image Restoration Toolbox (PyTorch). Training and testing codes for DPIR, USRNet, DnCNN, FFDNet, SRMD, DPSR, BSRGAN, SwinIR
- image-restoration
- denoising
- super-resolution
- sisr
[KDD'2026] "VideoRAG: Chat with Your Videos"
- large-language-models
- llms
- long-video-understanding
- multi-modal-llms
【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
- instruction-tuning
- large-vision-language-model
- multi-modal
A linter for YAML files.
- linter
- lint
- yaml
- yamllint
Digital Avatar Conversational System - Linly-Talker. 😄✨ Linly-Talker is an intelligent AI system that combines large language models (LLMs) with visual models to create a novel human-AI interaction method. 🤝🤖 It integrates various technologies like Whisper, Linly, Microsoft Speech Services, and SadTalker talking head generation system. 🌟🔬
An unnecessarily tiny implementation of GPT-2 in NumPy.
The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention
- large-language-models
- llm
- minimax-text-01
- minimax-vl-01
Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
- tensorlayer
- tensorflow
- super-resolution
- gan
Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
- agentic
- rlhf
- rlvr
A high-performance distributed training framework for Reinforcement Learning
- reinforcement-learning
- large-scale
- parallelization
Neo-reGeorg is a project that seeks to aggressively refactor reGeorg
- regeorg
- neoreg
- reduh
- socks-proxy
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
- gpt-4
- visual-language-learning
- artificial-inteligence
- deep-learning
pySLAM is a hybrid Python/C++ Visual SLAM pipeline supporting monocular, stereo, and RGB-D cameras. It provides a broad set of modern local and global feature extractors, multiple loop-closure strategies, a volumetric reconstruction module, integrated depth-prediction models, and semantic segmentation capabilities for enhanced scene understanding.
- 3d-reconstruction
- depth-prediction
- feature-matching
- global-features
Code for the paper "Evaluating Large Language Models Trained on Code"