Repository Index

CMAK is a tool for managing Apache Kafka clusters

• kafka
• scala
• cluster-management
• big-data

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

• spark
• acid
• big-data
• analytics

The leader in Customer Data Infrastructure

• snowplow
• analytics
• data
• data-pipeline

Wonderful reusable code from Twitter

• finagle
• scala
• utility

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

• spark
• hive
• sql
• thrift

Asynchronous, Reactive Programming for Scala and Scala.js.

• scala
• monix
• typelevel
• functional-programming

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

• actor-model
• cloud-native
• concurrency
• distributed-actors

Base classes to use when writing tests with Spark

MLeap: Deploy ML Pipelines to Production

• scikit-learn
• spark
• data-pipelines
• transformers

The Scala HTTP client you always wanted!

• scala
• http
• httpclient
• interpolator

Distributed Prometheus time series database

• scala
• time-series
• database
• distributed

Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments

• workflow-execution
• workflow
• cloud
• hpc

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

• spark
• big-data
• bioinformatics
• genomics

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

• snappydata
• spark
• memory-database
• analytics

Sparkling Water provides H2O functionality inside Spark cluster

• h2o
• spark
• machine-learning
• integration

:leaves: Non-blocking, Reactive MongoDB Driver for Scala

• scala
• reactivemongo
• mongodb
• database

Low-code tool for automating actions on real time data | Stream processing for the users.

• flink
• flink-kafka
• apache-flink
• gui

Create Docker images directly from sbt

• sbt
• sbt-plugin
• docker
• scala

Native Docker UI implemented using Scala.js and React - DEPRECATED

• docker
• scalajs
• react
• deprecated-repo

Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.

Storehaus is a library that makes it easy to work with asynchronous key value stores

Serverless proxy for Spark cluster

• apache-spark
• api
• big-data
• serverless

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

• spark
• neo4j-connector
• cypher
• neo4j-driver

Asynchronous InfluxDB client for Scala