Repository Index

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java

♞ lichess.org: the forever free, adless and open source chess server ♞

• scala
• chess
• play-framework
• non-profit

Removes large or troublesome blobs like git-filter-branch does, but faster. And written in Scala

• git

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

• dataquality
• spark
• unit-testing
• scala

Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.

• machine-learning
• mlsql
• bigdata
• sql-like-dsl

BlinkDB: Sub-Second Approximate Queries on Very Large Data.

Purely functional JSON parser and library in scala.

• argonaut
• scala
• json
• json-parser

A small, convenient, dependency-free library for command-line argument parsing in Scala

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

• fairness
• fairness-ml
• fairness-ai
• linkedin

Json/Protobuf convertors for ScalaPB use argonaut

• scalapb
• protobuf
• json
• scala