A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.
- isolation-forest
- spark
- linkedin
- outlier-detection
The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.
- fairness
- fairness-ml
- fairness-ai
- linkedin
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
A library that brings useful functions from various modern database management systems to Apache Spark
mobile app for tactical comms on protest marches
Web application for distributed compute analysis of Archive-It web archive collections.
Internet Archive's Sparkling Data Processing Library