✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
- large-multimodal-models
- multimodal-large-language-models
- omni-language-model
- omni-modal-video-understanding
81,588 visible repositories in the index
145–168 of 240 · Most stars
✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
OCRFlux is a lightweight yet powerful multimodal toolkit that significantly advances PDF-to-Markdown conversion, excelling in complex layout handling, complicated table parsing and cross-page content merging.
The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works on Windows, Linux, & macOS, with the free Gemini API, local LLMs, & more.
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption
An open-source Harness Engineering platform for coding agents—define harnesses as code, run controlled experiments, inspect evidence, and compare outcomes. Turn task evidence into actionable team and organization insights.
A simple, performant, and scalable Jax LLM!
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口
The Self-Coding System for Your App — Alan AI SDK for Web
State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!
I made my AI think harder by making it argue with itself repeatedly. It works stupidly well.
HRM-Text is a 1B text generation model based on the HRM architecture, strengthened by task completion and latent space reasoning.
A high-quality PDF to Markdown tool based on large language model visual recognition. 一款基于大模型视觉识别的高质量PDF转Markdown工具
A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
chat with private and local large language models
official repository of aiXcoder-7B Code Large Language Model
Build better UI with AI
Python library for Representation Learning on Knowledge Graphs https://docs.ampligraph.org
Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.
Meditron is a suite of open-source medical Large Language Models (LLMs).
Vim plugin for LLM-assisted code/text completion
An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)