Essential Spark extensions and helper methods ✨😲
- spark
- dataframe
Repository Index
47,133 repositories indexed
25–48 of 57 · Most stars
[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark
The fastest logging library in the world. Built from scratch in Scala and programmatically configurable.
- scribe
- scala
- slf4j
- logging
The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.
A simple testing framework for Scala
Stream Data Mining Library for Spark Streaming
Storehaus is a library that makes it easy to work with asynchronous key value stores
Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
recursion schemes for cats; to iterate is human, to recurse, divine
- scala
- recursion-schemes
- functional-programming
Akka CQRS/ES framework
Serverless proxy for Spark cluster
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
The book's repo
A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.
- isolation-forest
- spark
- outlier-detection
The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.
- fairness
- fairness-ml
- fairness-ai
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
A gatling plugin for running load tests on Apache Dubbo(https://github.com/apache/incubator-dubbo) and other java ecosystem.
- gatling
- dubbo
- java
- load-testing
SBT Plugin to ease working with JNI
- sbt-plugin
- jni
- scala
- sbt
Neo4j Scala library based on Anorm in the Play Framework
PMML evaluator library for Apache Spark
The first and only true Functional Reactive Programming framework for Scala.
- scala
- reactive
- frp
- frp-library
Scala Native GUI framework
- scala
- scala-native
- gui
- win32
A library that brings useful functions from various modern database management systems to Apache Spark