1.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+319 stars
from 44,087 · score 5.77
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
16 repositories by Attention Score · Oct 5, 2026 – Nov 3, 2026 (UTC)
2.delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
+35 stars
from 9,031 · score 3.58
3.snowplow / snowplow
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
- data-collection
- product-analytics
- +3 more
+16 stars
from 7,032 · score 2.83
4.awslabs / deequ
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
+13 stars
from 3,644 · score 2.64
5.apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
+13 stars
from 2,363 · score 2.64
6.softwaremill / elasticmq
In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.
- scala
- sqs-interface
- elasticmq
- amazon-sqs
- aws
- aws-sqs
- +1 more
+11 stars
from 2,942 · score 2.48
7.yahoo / CMAK
CMAK is a tool for managing Apache Kafka clusters
+5 stars
from 11,913 · score 1.79
8.typelevel / fs2
Compositional, streaming I/O library for Scala
- scala
- stream
- streaming-computation
- fp
- functional-programming
+3 stars
from 2,453 · score 1.39
9.graphframes / graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
- apache-spark
- big-data
- connected-components
- dataframe
- dataframes
- graphs
- +8 more
+2 stars
from 1,210 · score 1.10
10.TouK / nussknacker
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
- touk
- real-time
- +13 more
+2 stars
from 743 · score 1.10
11.helgeho / ArchiveSpark
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
- webarchive
- internet-archive
- +1 more
+2 stars
from 162 · score 1.10
12.archivesunleashed / aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
- spark
- hadoop
- webarchives
- analysis
- apache-spark
- scala
- +8 more
+2 stars
from 157 · score 1.10
13.apache / livy
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
+1 stars
from 960 · score 0.69
14.gearpump / gearpump
Lightweight real-time big data streaming engine over Apache Pekko
- akka
- stream-processing
- bigdata
- scala
+1 stars
from 755 · score 0.69
15.neo4j / neo4j-spark-connector
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
- bolt
- hacktoberfest
+1 stars
from 323 · score 0.69
16.galax-io / gatling-kafka-plugin
Gatling plugin for Apache Kafka — produce, request-reply, and consume load testing with Avro, Protobuf, and Schema Registry support
- gatling
- kafka
- performance
- performance-testing
- avro
- java
- +5 more
+1 stars
from 24 · score 0.69