1.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+1,414 stars
from 43,009 · score 7.25
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
19 repositories by Attention Score · May 9, 2026 – Nov 4, 2026 (UTC)
2.delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
+337 stars
from 8,730 · score 5.82
3.softwaremill / elasticmq
In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.
- scala
- sqs-interface
- elasticmq
- amazon-sqs
- aws
- aws-sqs
- +1 more
+117 stars
from 2,836 · score 4.77
4.apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
+66 stars
from 2,310 · score 4.20
5.snowplow / snowplow
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
- data-collection
- product-analytics
- +3 more
+60 stars
from 6,988 · score 4.11
6.awslabs / deequ
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
+60 stars
from 3,596 · score 4.11
7.graphframes / graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
- apache-spark
- big-data
- connected-components
- dataframe
- dataframes
- graphs
- +8 more
+43 stars
from 1,169 · score 3.78
8.yahoo / CMAK
CMAK is a tool for managing Apache Kafka clusters
+40 stars
from 11,879 · score 3.71
9.TouK / nussknacker
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
- touk
- real-time
- +13 more
+23 stars
from 722 · score 3.18
10.typelevel / fs2
Compositional, streaming I/O library for Scala
- scala
- stream
- streaming-computation
- fp
- functional-programming
+20 stars
from 2,436 · score 3.04
11.apache / livy
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
+18 stars
from 943 · score 2.94
12.apache / cassandra-spark-connector
Apache Spark to Apache Cassandra connector
+12 stars
from 1,943 · score 2.56
13.h2oai / sparkling-water
Sparkling Water provides H2O functionality inside Spark cluster
- h2o
- spark
- machine-learning
- integration
- pysparkling
- rsparkling
- +3 more
+6 stars
from 976 · score 1.95
14.neo4j / neo4j-spark-connector
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
- bolt
- hacktoberfest
+6 stars
from 318 · score 1.95
15.helgeho / ArchiveSpark
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
- webarchive
- internet-archive
- +1 more
+5 stars
from 159 · score 1.79
16.archivesunleashed / aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
- spark
- hadoop
- webarchives
- analysis
- apache-spark
- scala
- +8 more
+4 stars
from 155 · score 1.61
17.twitter / summingbirdArchived
Streaming MapReduce with Scalding and Storm
+1 stars
from 2,120 · score 0.69
18.cloudera / livy
Livy is an open source REST interface for interacting with Apache Spark from anywhere
+1 stars
from 1,005 · score 0.69
19.Stratio / Spark-MongoDBArchived
Spark library for easy MongoDB access
+1 stars
from 305 · score 0.69