[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
Repository Index
111,085 visible repositories in the index
145–168 of 454 · Most stars
Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"
- generation
- large-language-models
- vision-language-model
Inspect: A framework for large language model evaluations
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
- agent
- artificial-intelligence
- benchmark
- multimodal
[IROS 2025 Best Paper Award Finalist & IEEE TRO 2026] The Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems
- robotic-manipulation
- vision-language-action-model
- pretraining-for-robotics
- robotic-foundation-model
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
- webdataset
- webdataset-format
- data-augmentation
- pytorch
MiniMax-M1, the world's first open-weight, large-scale hybrid-attention reasoning model.
- large-language-models
- llm
- reasoning-models
- minimax-m1
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
- knowledge-distillation
- model-compression
- quantization
- pretrained-models
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
- large-language-models
- multimodal-large-language-models
- speech-language-model
- speech-to-speech
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
- large-language-models
- video-language-pretraining
- vision-language-pretraining
- blip2
The largest open-source medical AI skills library for OpenClaw🦞.
- awesome
- claude-code
- clawhub
- medical
Implementation for MatMul-free LM.
- llm
- large-language-model
- linear-transformer
Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
AI Search & RAG Without Moving Your Data. Get instant answers from your company's knowledge across 100+ apps while keeping data secure. Deploy in minutes, not months.
- search
- search-engine
- federated-query
- federated-search
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.
⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
- chatgpt
- visual-language-learning
- multi-modality
- foundation
Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)
A 13B large language model developed by Baichuan Intelligent Technology
- artificial-intelligence
- chatgpt
- chinese
- gpt-4
Minimalistic large language model 3D-parallelism training
[CVPR 2023 Highlight] InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions
- backbone
- deformable-convolution
- object-detection
- semantic-segmentation
Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
- graph-structures
- graphs
- large-language-models
- llm