Repository Index

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java

♞ lichess.org: the forever free, adless and open source chess server ♞

• scala
• chess
• play-framework
• non-profit

Apache OpenWhisk is an open source serverless cloud platform

• openwhisk
• apache
• serverless
• cloud

State of the Art Natural Language Processing

• nlp
• natural-language-processing
• spark
• pyspark

Generic programming for Scala

• scala
• typelevel
• functional-programming
• generic-programming

In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.

• scala
• sqs-interface
• elasticmq
• amazon-sqs

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

• spark
• hive
• sql
• thrift

Apache Spark to Apache Cassandra connector

• cassandra
• scala
• spark

A data access library for Scala + Postgres.

• scala
• postgres
• functional-programming
• cats

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

• actor-model
• cloud-native
• concurrency
• distributed-actors

Base classes to use when writing tests with Spark

Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments

• workflow-execution
• workflow
• cloud
• hpc

Modify deeply nested case class fields

• scala
• lenses
• functional-programming

uPickle: a simple, fast, dependency-free JSON & Binary (MessagePack) serialization library for Scala

Essential Spark extensions and helper methods ✨😲

• spark
• dataframe

Lightweight real-time big data streaming engine over Apache Pekko

• akka
• stream-processing
• bigdata
• scala

Low-code tool for automating actions on real time data | Stream processing for the users.

• flink
• flink-kafka
• apache-flink
• gui

The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.

recursion schemes for cats; to iterate is human, to recurse, divine

• scala
• recursion-schemes
• functional-programming

Serverless proxy for Spark cluster

• apache-spark
• api
• big-data
• serverless

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

• spark
• neo4j-connector
• cypher
• neo4j-driver

A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.

• isolation-forest
• spark
• linkedin
• outlier-detection

Build tool for Scala projects

• scala
• scala-native
• scalajs
• build-tool

A scala library for interacting with the slack api and real time messaging interface

• hacktoberfest
• scala
• slack
• scala-library