Repository Index

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java

State of the Art Natural Language Processing

• nlp
• natural-language-processing
• spark
• pyspark

Lightweight real-time big data streaming engine over Apache Pekko

• akka
• stream-processing
• bigdata
• scala

Low-code tool for automating actions on real time data | Stream processing for the users.

• flink
• flink-kafka
• apache-flink
• gui

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving

Exercise used for our recruitment process

Internet Archive's Sparkling Data Processing Library