WarcDB: Web crawl data as SQLite databases.
Repository Index
47,133 repositories indexed
1–2 of 2 · Most stars
:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript