UnifiedArchive - an archive manager with unified interface for different formats (bundled with cli utility). Supports all formats with basic operations (reading, extracting and creation) and popular formats specific features (compression level, password-protection, comment)
📜 A CLI toolkit for extracting and working with your digital history
- chronicle
- chronicle-etl
- personal-data
- etl
Cloud-native continuous backup for PostgreSQL - WAL/base-backup streaming, compression, encryption, retention, and monitoring in a single binary.
Document management for small businesses.
- dms
- documents
- documents-management
- documents-manager
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
An ActiveRecord plugin for atomic archiving and unarchiving of object trees. Inspired by ActsAsParanoid and PermanentRecord
A list of things related to software, literature, and other content for 🕣 Memento
Parse And Create Web ARChive (WARC) files with node.js
- webarchive
- webarchiving
- web-archives
- warc-files
A Memento Aggregator CLI and Server in Go
- web-archiving
- memento
- timemap
- memento-rfc
A collection of tools for archiving and analysing the internet.
Various Jupyter notebooks about Common Crawl data
Web archive index server based on RocksDB
Converts HTTrack crawls to WARC files
A set of tools to use with the PlayCanvas REST API for common jobs such as downloading a build and archiving a project
A tool for detecting viruses and NSFW material in WARC files
- antivirus
- nsfw-classifier
- warc
- warc-safe
Various archiving/compression programs and libraries for ComputerCraft
A toolkit makes it easier to archive webpages to IPFS
Tika based link (URL) extractor for httpreserve
- webarchiving
- tika
- tika-wrapper
- httpreserve
CLI implementation of httpreserve that can test links and retrieve internet archive replacements
- code4lib
- web-archiving
- digipres
- digital-preservation
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz
A RAD Studio IDE plug-in to run console applications before and after compilation along with zipping the project source for archiving.
An Ada 2012 library for document container files
Intelligent web page comparison tool with Wayback Machine support and visual regression testing
Parse CDXJ(https://github.com/oduwsdl/ORS/wiki/CDXJ) files with node.js
- webarchive
- webarchiving
- web-archives
- cdxj