Web archive index server based on RocksDB
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
Converts HTTrack crawls to WARC files
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz
Partition (W)ARC Files by MIME Type and Year