A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
57,138 visible repositories in the index
1–24 of 49 · Most stars
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
- ocr
- chineseocr
- pdf2markdown
- pp-ocr
Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Convert PDF to markdown + JSON quickly with high accuracy
[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation
- knowledge-graph
- large-language-models
- retrieval-augmented-generation
- genai
SGLang is a high-performance serving framework for large language models and multimodal models.
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI
SkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits, validation-gated updates, and deployable best_skill.md artifacts.
- agent-skills
- self-evolving-agents
The absolute trainer to light up AI agents.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
- mupdf
- xps
- pdf-documents
- epub
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
High accuracy RAG for answering questions from scientific documents with citations
A lightweight LMM-based Document Parsing Model
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Gemma open-weight LLM library, from Google DeepMind
[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
- ai
- chain-of-thought
- collaboration
- dataset-generation
Zero-modification Human-in-the-Loop adapter for OpenOPC's agentic DAG runtime.
🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines
- rag
- chonkie
- chunker
- chunking-algorithm
The first AI agent that builds permissionless integrations through reverse engineering platforms' internal APIs.