Repository Index

🌱 TDF - Tree Document Format - a universal file format for web collections

• archive
• web-archive
• archiver
• internet

Streaming WARC/ARC library for fast web archive IO

• web-archives
• web-archiving
• warc
• pywb

Parse And Create Web ARChive (WARC) files with node.js

• webarchive
• webarchiving
• web-archives
• warc-files

Various examples of notebooks for working with web archives with the Archives Unleashed Toolkit, and derivatives generated by the Archives Unleashed Toolkit.

• notebooks
• pyspark-notebook
• juypter-notebook
• spark

DuckDB extension to fetch pages from Wayback Machine & Common Crawl

• archived
• common-crawl
• duckdb
• duckdb-extension

Create Robust Links from within Zotero

• references
• reference-rot
• link-rot
• memento

A Tool to Summarize Web Archive Holdings

• memento
• web-archive
• profiling
• mementomap

Parse CDXJ(https://github.com/oduwsdl/ORS/wiki/CDXJ) files with node.js

• webarchive
• webarchiving
• web-archives
• cdxj