Repository Index

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

• spark
• acid
• big-data
• analytics

Apache OpenWhisk is an open source serverless cloud platform

• openwhisk
• apache
• serverless
• cloud

Create Docker images directly from sbt

• sbt
• sbt-plugin
• docker
• scala

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

• spark
• hadoop
• webarchives
• analysis

mobile app for tactical comms on protest marches

Web application for distributed compute analysis of Archive-It web archive collections.

Internet Archive's Sparkling Data Processing Library

Send Gatling logs to Elasticsearch

• gatling
• elasticsearch
• load-testing
• performance-testing

An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.

• spark
• tweets
• twitter-data
• twitter-json