Repository Index

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

• pocket
• wget
• browser-bookmarks
• pinboard

InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS

• ipfs
• warc
• wayback
• web-archiving

Streaming WARC/ARC library for fast web archive IO

• web-archives
• web-archiving
• warc
• pywb

WarcDB: Web crawl data as SQLite databases.

• crawling
• sqlite
• warc
• cli

Intelligent web page comparison tool with Wayback Machine support and visual regression testing

• visual-comparison
• wayback-machine
• web-scraping
• diff