1.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+767 stars
from 43,639 · score 6.64
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
22 repositories by Attention Score · Aug 6, 2026 – Nov 3, 2026 (UTC)
2.delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
+161 stars
from 8,905 · score 5.09
3.softwaremill / elasticmq
In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.
- scala
- sqs-interface
- elasticmq
- amazon-sqs
- aws
- aws-sqs
- +1 more
+48 stars
from 2,905 · score 3.89
4.apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
+32 stars
from 2,344 · score 3.50
5.snowplow / snowplow
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
- data-collection
- product-analytics
- +3 more
+31 stars
from 7,017 · score 3.47
6.awslabs / deequ
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
+28 stars
from 3,629 · score 3.37
7.graphframes / graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
- apache-spark
- big-data
- connected-components
- dataframe
- dataframes
- graphs
- +8 more
+18 stars
from 1,194 · score 2.94
8.yahoo / CMAK
CMAK is a tool for managing Apache Kafka clusters
+14 stars
from 11,904 · score 2.71
9.typelevel / fs2
Compositional, streaming I/O library for Scala
- scala
- stream
- streaming-computation
- fp
- functional-programming
+13 stars
from 2,443 · score 2.64
10.apache / cassandra-spark-connector
Apache Spark to Apache Cassandra connector
+7 stars
from 1,948 · score 2.08
11.TouK / nussknacker
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
- touk
- real-time
- +13 more
+7 stars
from 738 · score 2.08
12.bigdatagenomics / adam
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
- spark
- big-data
- bioinformatics
- genomics
- parquet
- avro
- +4 more
+6 stars
from 1,054 · score 1.95
13.apache / livy
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
+6 stars
from 955 · score 1.95
14.linkedin / isolation-forest
A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.
- isolation-forest
- spark
- outlier-detection
- unsupervised-learning
- machine-learning
- +3 more
+4 stars
from 261 · score 1.61
15.h2oai / sparkling-water
Sparkling Water provides H2O functionality inside Spark cluster
- h2o
- spark
- machine-learning
- integration
- pysparkling
- rsparkling
- +3 more
+3 stars
from 979 · score 1.39
16.galax-io / gatling-kafka-plugin
Gatling plugin for Apache Kafka — produce, request-reply, and consume load testing with Avro, Protobuf, and Schema Registry support
- gatling
- kafka
- performance
- performance-testing
- avro
- java
- +5 more
+3 stars
from 22 · score 1.39
17.filodb / FiloDB
Distributed Prometheus time series database
- scala
- time-series
- database
- distributed
- prometheus
- metrics
- +2 more
+2 stars
from 1,466 · score 1.10
18.helgeho / ArchiveSpark
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
- webarchive
- internet-archive
- +1 more
+2 stars
from 162 · score 1.10
19.archivesunleashed / aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
- spark
- hadoop
- webarchives
- analysis
- apache-spark
- scala
- +8 more
+2 stars
from 157 · score 1.10
20.spark-jobserver / spark-jobserver
REST job server for Apache Spark
+1 stars
from 2,832 · score 0.69
21.gearpump / gearpump
Lightweight real-time big data streaming engine over Apache Pekko
- akka
- stream-processing
- bigdata
- scala
+1 stars
from 755 · score 0.69
22.neo4j / neo4j-spark-connector
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
- bolt
- hacktoberfest
+1 stars
from 323 · score 0.69