Simple, unified interface to multiple Generative AI providers
Repository Index
132,241 visible repositories in the index
1–24 of 90 · Most stars
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
Semantic search over videos using Gemini Embedding 2 or Qwen3-VL.
- chromadb
- dashcam
- gemini
- gemini-embedding-2
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
- agi
- evaluation
- large-language-models
- multimodal
PyTorch code and models for V-JEPA self-supervised learning from video.
Google Gen AI Python SDK provides an interface for developers to integrate Google's generative models into their Python applications.
[KDD'2026] "VideoRAG: Chat with Your Videos"
- large-language-models
- llms
- long-video-understanding
- multi-modal-llms
Copy-ready prompts for the leading AI video and image models, each with its real output and source. Plus agent recipes for editing video.
- awesome
- awesome-list
- agents
- ai-video
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
- machine-learning
- convolutional-networks
- embedding-vectors
- embeddings
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
LLM-as-a-Verifier is a general-purpose framework that provides fine-grained feedback for any agent without requiring additional training. It achieves SOTA performance across coding, robotics, and medical agentic benchmarks.
This is an extension based on sd-webui, aimed at improving the user experience of the prompt/negative prompt input box. It has a more intuitive and powerful input interface function, and provides automatic translation, history record, and bookmarking functions. 这是一个基于 sd-webui 的扩展,旨在提高提示词/反向提示词输入框的使用体验。它拥有更直观、强大的输入界面功能,它提供了自动翻译、历史记录和收藏等功能。
InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
- large-language-models
- video-language-pretraining
- vision-language-pretraining
- blip2
A general fine-tuning kit geared toward image/video/audio diffusion models.
- diffusers
- diffusion-models
- fine-tuning
- flux-dev
⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
- chatgpt
- visual-language-learning
- multi-modality
- foundation
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
- deep-learning
- fine-tuning
- gpt-2
- gpt-j
✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
- large-multimodal-models
- multimodal-large-language-models
- omni-language-model
- omni-modal-video-understanding
mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
Automatic Video Generation from Scientific Papers
Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.