Repository Index

A community-supported supercharged document management system: scan, index and archive all your documents

• angular
• archiving
• django
• dms

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

• pocket
• wget
• browser-bookmarks
• pinboard

Continuous Archiving for Postgres

• python
• backup
• backups
• postgresql

Backup and recovery manager for PostgreSQL

• backup
• incremental-backups
• restore
• archiving

InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS

• ipfs
• warc
• wayback
• web-archiving

Streaming WARC/ARC library for fast web archive IO

• web-archives
• web-archiving
• warc
• pywb

WarcDB: Web crawl data as SQLite databases.

• crawling
• sqlite
• warc
• cli

A collection of tools for archiving and analysing the internet.

A tool for detecting viruses and NSFW material in WARC files

• antivirus
• nsfw-classifier
• warc
• warc-safe

Intelligent web page comparison tool with Wayback Machine support and visual regression testing

• visual-comparison
• wayback-machine
• web-scraping
• diff