[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Repository Index
111,821 visible repositories in the index
1–15 of 15 · Most stars
PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!
- pdfgpt
- chatpdf
- chatwithpdf
Web Crawling and RAG Capabilities for AI Agents and AI Coding Assistants
Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.
Benchmark for tracking model capability after release.
Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。
A benchmark built to evaluate and improve agent capabilities for supporting legal work.
WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.
An alignment auditing agent capable of quickly exploring alignment hypothesis
OpenAI-compatible API for Gemini Business with multi-account load balancing and multimodal capabilities (image/video generation, file parsing) | 将 Gemini Business 转为 OpenAI 兼容接口,支持多账户负载均衡及多模态能力(图像生成、视频生成、解析文件)
ZeroSearch: Incentivize the Search Capability of LLMs without Searching
[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.
- foundation-models
- lmm
- vision-and-language
- vision-language-model
From a universe of models to Collective Model Intelligence.
- collective-model-intelligence
- model-capabilities
- model-collaboration