🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 31 · Most stars
SGLang is a high-performance serving framework for large language models and multimodal models.
Build and run agents you can see, understand and trust.
See, hear, and interact on your local devices.
- minicpm
- minicpm-v
- multi-modal
- minicpm-o
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
- semantic-search
- information-retrieval
- ai
- python
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
"RAG-Anything: All-in-One RAG Framework"
- multi-modal-rag
- retrieval-augmented-generation
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
☁️ Build multimodal AI applications with cloud-native stack
- neural-search
- cloud-native
- deep-learning
- machine-learning
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
- machine-translation
- speaker-recognition
- asr
- tts
Janus-Series: Unified Multimodal Understanding and Generation Models
- any-to-any
- foundation-models
- llm
- multimodal
Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community.
- ai
- real-time
- voice
- voice-assistant
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
An open source implementation of CLIP.
- deep-learning
- pytorch
- computer-vision
- language-model
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
- bert
- sentence-encoding
- deep-learning
- clip-model
Open-source framework for conversational voice AI agents
A framework to enable a multimodal model to operate a computer.
- automation
- openai
- pyautogui
Translated[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. An open-source multimodal dialogue model with performance close to GPT-4o
- image-classification
- image-text-retrieval
- llm
- semantic-segmentation
FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models
NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.
Eclipse SUMO is an open source, highly portable, microscopic and continuous traffic simulation package designed to handle large networks. It allows for intermodal simulation including pedestrians and comes with a large set of tools for scenario creation.
- traffic
- simulation
- transport
A modular active learning framework for Python
- scikit-learn
- machine-learning
- python
- active-learning
A Multilingual, Multimodal Translation Model Family
- llm
- machine-translation
EdgeRock: Strong Reasoning at Constant Memory. Multimodal models with O(N) generation and O(1) persistent history. Inference and evaluation code.