An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
Repository Index
47,133 repositories indexed
1–5 of 5 · Most stars
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Web application for distributed compute analysis of Archive-It web archive collections.
Internet Archive's Sparkling Data Processing Library
An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.
- spark
- tweets
- twitter-data
- twitter-json