Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
Repository Index
47,133 repositories indexed
1–24 of 34 · Most stars
CMAK is a tool for managing Apache Kafka clusters
A Git platform powered by Scala with easy installation, high extensibility & GitHub API compatibility
- scala
- gitbucket
- git
- scalatra
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
Generic programming for Scala
- scala
- typelevel
- functional-programming
- generic-programming
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
- apache-spark
- big-data
- connected-components
- dataframe
Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Sparkling Water provides H2O functionality inside Spark cluster
- h2o
- spark
- machine-learning
- integration
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
CPU and GPU-accelerated Machine Learning Library
uPickle: a simple, fast, dependency-free JSON & Binary (MessagePack) serialization library for Scala
Lightweight real-time big data streaming engine over Apache Pekko
- akka
- stream-processing
- bigdata
- scala
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
Serverless proxy for Spark cluster
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
A Bitcoin Script Interpreter and Debugger in Scala
Big Data Science Swiss Army Knife - http://www.tuktu.io --
OpenGL and SDL2 bindings for Scala Native
- scala-native
- scala
- scala-library
- opengl
mobile app for tactical comms on protest marches
scala-native bindings for Gtk+, GLib, ...
- scala-native
- gtk
- glib