Repository Index

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

• pocket
• wget
• browser-bookmarks
• pinboard

An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.

• telegram
• archive
• wayback-machine
• save-the-internet

Extract web archive data using Wayback Machine and Common Crawl

• golang
• crawler
• commoncrawl
• wayback-machine

DuckDB extension to fetch pages from Wayback Machine & Common Crawl

• archived
• common-crawl
• duckdb
• duckdb-extension

CLI implementation of httpreserve that can test links and retrieve internet archive replacements

• code4lib
• web-archiving
• digipres
• digital-preservation

Fetch and normalize parameterized URLs from the Wayback CDX API (OSINT, inspired by ParamSpider).

• bugbounty
• cdx
• cli
• kali-linux

Intelligent web page comparison tool with Wayback Machine support and visual regression testing

• visual-comparison
• wayback-machine
• web-scraping
• diff