An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
47,133 repositories indexed
1–3 of 3 · Most stars
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
Web application for distributed compute analysis of Archive-It web archive collections.
Internet Archive's Sparkling Data Processing Library