Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
Repository Index
47,133 repositories indexed
1–24 of 24 · Most stars
Python tool for converting files and office documents to Markdown.
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
- ocr
- chineseocr
- pdf2markdown
- pp-ocr
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
Get your documents ready for gen AI
Convert PDF to markdown + JSON quickly with high accuracy
PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.
Convert Word, PowerPoint, Excel, OpenDocument, RTF, EPUB, CSV, and PDF to clean Markdown. Built in Rust, with Node.js and Python bindings.
Toolkit for linearizing PDFs for LLM datasets/training
Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase
- ai
- code
- ingestion
- developer-tool
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
- deep-learning
- document-parsing
- machine-learning
- nlp
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
A fast, helpful, and open-source document parser
- document-ocr
- document-processing
- ocr
- ocr-recognition
OCR model that handles complex tables, forms, handwriting with full layout.
OCR & Document Extraction using vision models
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
- mupdf
- xps
- pdf-documents
- epub
The fast, precise document-intelligence engine for every language: text, tables and metadata from 100+ formats, with OCR, transcription and code intelligence.
- text-extraction
- document-intelligence
- metadata-extraction
- pdf-extraction
An open-source document parsing model with SOTA accuracy and speed, using an RSI loop during post-training.
1M param OCR model - runs on CPU, 15x faster than tesseract, close to 1B+ param models in accuracy
Xiaomi-OCR-0
Fast, accurate OCR with correctness assessment.
- image2text
- minicpm-v
- ocr
WeVisDoc is an end-to-end document parser for page images. Fine-tuned from Qwen3-VL-2B-Instruct and Qwen3-VL-4B-Instruct, it turns a page into structured Markdown, with LaTeX formulas and HTML tables.
Rust web scraper & crawler for AI agents: URLs, PDFs and Office files → clean Markdown/JSON. Firecrawl- and Jina Reader-compatible API, MCP server, Python/Node SDKs. Self-hosted single binary.
- ai-agents
- browser-automation
- data-extraction
- firecrawl