A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
55,140 visible repositories in the index
1–13 of 13 · Most stars
Convert PDF to markdown + JSON quickly with high accuracy
SGLang is a high-performance serving framework for large language models and multimodal models.
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
- mupdf
- xps
- pdf-documents
- epub
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
High accuracy RAG for answering questions from scientific documents with citations
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
A production-grade, high-efficiency Agentic RL framework for frontier LLMs with validated recipes.
Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decoding && Youtu-Parsing-Omni: One Encoder, One Schema, All Modalities
Open standard for Provenance & Intent Contracts (PIC) in AI agents. Verify intent, provenance, and evidence before high-impact tool calls.
- action-proposals
- agentic-ai
- agents
- ai