Parse And Create Web ARChive (WARC) files with node.js
Repository Index
47,133 repositories indexed
1–5 of 5 · Most stars
Web archive index server based on RocksDB
Converts HTTrack crawls to WARC files
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz
Partition (W)ARC Files by MIME Type and Year