Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
Repository Index
47,133 repositories indexed
1–24 of 57 · Most stars
♞ lichess.org: the forever free, adless and open source chess server ♞
- scala
- chess
- play-framework
- non-profit
The Community Maintained High Velocity Web Framework For Java and Scala.
- scala
- java
- reactive
- web-framework
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
State of the Art Natural Language Processing
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
REST job server for Apache Spark
A better build tool for Java, Scala and Kotlin: Simpler than Maven, easier than Gradle, with 3-7x faster dev workflows than other JVM build tools
- scala
- build-tool
- build-system
- java
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Apache Spark to Apache Cassandra connector
Base classes to use when writing tests with Spark
MLeap: Deploy ML Pipelines to Production
- scikit-learn
- spark
- data-pipelines
- transformers
Code to accompany Advanced Analytics with Spark from O'Reilly Media
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
- apache-spark
- big-data
- connected-components
- dataframe
Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster
Livy is an open source REST interface for interacting with Apache Spark from anywhere
Sparkling Water provides H2O functionality inside Spark cluster
- h2o
- spark
- machine-learning
- integration
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
Free fork of NotProton: Windows Steam games in Mac Steam, on CodeWeavers' Wine and Apple's Game Porting Toolkit
- apple-silicon
- d3dmetal
- dxmt
- dxvk
Scala macros for compile-time generation of safe and ultra-fast JSON codecs + circe booster
- scala
- json
- high-performance
- serialization