🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
Repository Index
47,133 repositories indexed
1–14 of 14 · Most stars
A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
Streaming WARC/ARC library for fast web archive IO
WarcDB: Web crawl data as SQLite databases.
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
Parse And Create Web ARChive (WARC) files with node.js
A Memento Aggregator CLI and Server in Go
Web archive index server based on RocksDB
Converts HTTrack crawls to WARC files
CLI implementation of httpreserve that can test links and retrieve internet archive replacements
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz
Intelligent web page comparison tool with Wayback Machine support and visual regression testing
Partition (W)ARC Files by MIME Type and Year