1.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+771 stars
from 43,652 · score 6.65
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
55 repositories by Attention Score · Aug 7, 2026 – Nov 4, 2026 (UTC)
2.delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
+161 stars
from 8,906 · score 5.09
3.gitbucket / gitbucket
A Git platform powered by Scala with easy installation, high extensibility & GitHub API compatibility
- scala
- gitbucket
- git
- scalatra
+51 stars
from 9,366 · score 3.95
4.softwaremill / elasticmq
In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.
- scala
- sqs-interface
- elasticmq
- amazon-sqs
- aws
- aws-sqs
- +1 more
+47 stars
from 2,906 · score 3.87
5.apache / pekko
Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala
- actor-model
- cloud-native
- concurrency
- distributed-actors
- distributed-systems
- high-performance
- +4 more
+47 stars
from 1,616 · score 3.87
6.scala / scala
Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
- scala
- scala-compiler
- scala-programming-language
- scala-library
- jvm-languages
- functional-programming
- +1 more
+42 stars
from 14,493 · score 3.76
7.gatling / gatling
Modern Load Testing as Code
- netty
- scala
- loadtesting
- automation
- gatling
- load-testing
- +13 more
+39 stars
from 6,918 · score 3.69
8.apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
+32 stars
from 2,344 · score 3.50
9.snowplow / snowplow
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
- data-collection
- product-analytics
- +3 more
+30 stars
from 7,018 · score 3.43
+28 stars
from 3,557 · score 3.37
11.awslabs / deequ
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
+27 stars
from 3,629 · score 3.33
12.lhartikk / ArnoldC
Arnold Schwarzenegger based programming language
+26 stars
from 6,858 · score 3.30
13.apache / openwhisk
Apache OpenWhisk is an open source serverless cloud platform
- openwhisk
- apache
- serverless
- cloud
- faas
- functions-as-a-service
- +5 more
+23 stars
from 6,781 · score 3.18
14.playframework / playframework
The Community Maintained High Velocity Web Framework For Java and Scala.
- scala
- java
- reactive
- web-framework
- restful
- play
- +5 more
+21 stars
from 12,601 · score 3.09
15.apache / predictionioArchived
PredictionIO, a machine learning server for developers and ML engineers.
- scala
- big-data
- predictionio
+19 stars
from 12,500 · score 3.00
16.graphframes / graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
- apache-spark
- big-data
- connected-components
- dataframe
- dataframes
- graphs
- +8 more
+17 stars
from 1,195 · score 2.89
17.yahoo / CMAK
CMAK is a tool for managing Apache Kafka clusters
+15 stars
from 11,904 · score 2.77
18.prisma / prisma1Archived
💾 Database Tools incl. ORM, Migrations and Admin UI (Postgres, MySQL & MongoDB) [deprecated]
- orm
- database
- graphql
- datamapper
- serverless
- dao
- +1 more
+14 stars
from 16,356 · score 2.71
19.JohnSnowLabs / spark-nlp
State of the Art Natural Language Processing
- nlp
- natural-language-processing
- spark
- pyspark
- named-entity-recognition
- sentiment-analysis
- +14 more
+14 stars
from 4,146 · score 2.71
+12 stars
from 2,129 · score 2.56
21.apache / cassandra-spark-connector
Apache Spark to Apache Cassandra connector
+7 stars
from 1,948 · score 2.08
22.softwaremill / sttp
The Scala HTTP client you always wanted!
- scala
- http
- httpclient
- interpolator
- uri
- asynchronous
- +12 more
+7 stars
from 1,499 · score 2.08
23.TouK / nussknacker
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
- touk
- real-time
- +13 more
+7 stars
from 738 · score 2.08
24.monix / monix
Asynchronous, Reactive Programming for Scala and Scala.js.
- scala
- monix
- typelevel
- functional-programming
- reactive-programming
- fp
- +4 more
+6 stars
from 1,926 · score 1.95
25.combust / mleap
MLeap: Deploy ML Pipelines to Production
- scikit-learn
- spark
- data-pipelines
- transformers
- tensorflow
- scala
- +1 more
+6 stars
from 1,539 · score 1.95
+6 stars
from 1,335 · score 1.95
27.scalalandio / chimney
Scala library for boilerplate-free, type-safe data transformations
- scala
- boilerplate
- generic-programming
- automatic-conversion
- auto-mapping
- data-rewriting
- +12 more
+6 stars
from 1,251 · score 1.95
28.apache / livy
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
+6 stars
from 955 · score 1.95
+5 stars
from 2,538 · score 1.79
30.bigdatagenomics / adam
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
- spark
- big-data
- bioinformatics
- genomics
- parquet
- avro
- +4 more
+5 stars
from 1,054 · score 1.79
31.scalacenter / bloop
Bloop is a build server and CLI tool to compile, test and run Scala fast from any editor or build tool.
- scala
- productivity
- developer-tools
- compilation-server
- java
- build-system
- +1 more
+5 stars
from 939 · score 1.79
+4 stars
from 2,716 · score 1.61
33.scalatest / scalatest
A testing tool for Scala and Java developers
+4 stars
from 1,166 · score 1.61
+3 stars
from 3,518 · score 1.39
35.milessabin / shapeless
Generic programming for Scala
- scala
- typelevel
- functional-programming
- generic-programming
- fp
+3 stars
from 3,398 · score 1.39
36.sangria-graphql / sangria
Scala GraphQL implementation
+3 stars
from 1,960 · score 1.39
37.filodb / FiloDB
Distributed Prometheus time series database
- scala
- time-series
- database
- distributed
- prometheus
- metrics
- +2 more
+3 stars
from 1,466 · score 1.39
38.h2oai / sparkling-water
Sparkling Water provides H2O functionality inside Spark cluster
- h2o
- spark
- machine-learning
- integration
- pysparkling
- rsparkling
- +3 more
+3 stars
from 979 · score 1.39
39.galax-io / gatling-kafka-plugin
Gatling plugin for Apache Kafka — produce, request-reply, and consume load testing with Avro, Protobuf, and Schema Registry support
- gatling
- kafka
- performance
- performance-testing
- avro
- java
- +5 more
+3 stars
from 22 · score 1.39
+2 stars
from 748 · score 1.10
41.archivesunleashed / aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
- spark
- hadoop
- webarchives
- analysis
- apache-spark
- scala
- +8 more
+2 stars
from 157 · score 1.10
42.galax-io / gatling-picatinny
Gatling DSL extensions — feeders, profile management, transactions, assertions, Redis integration, and utility functions
- gatling
- performance
- performance-testing
- gatling-plugin
- dsl
- feeders
- +6 more
+2 stars
from 12 · score 1.10
43.galax-io / gatling-jdbc-plugin
Gatling plugin for JDBC — SQL queries, batch operations, and stored procedures with HikariCP connection pooling
- gatling
- performance
- performance-testing
- jdbc
- gatling-plugin
- hikaricp
- +6 more
+2 stars
from 9 · score 1.10
44.holdenk / spark-testing-base
Base classes to use when writing tests with Spark
+1 stars
from 1,553 · score 0.69
45.ghostdogpr / caliban
Functional GraphQL library for Scala
- scala
- graphql
- graphql-server
- functional-programming
- graphql-client
+1 stars
from 992 · score 0.69
46.typelevel / squants
The Scala API for Quantities, Units of Measure and Dimensional Analysis
+1 stars
from 930 · score 0.69
+1 stars
from 851 · score 0.69
48.gearpump / gearpump
Lightweight real-time big data streaming engine over Apache Pekko
- akka
- stream-processing
- bigdata
- scala
+1 stars
from 755 · score 0.69
+1 stars
from 677 · score 0.69
50.scalameta / munit
Scala testing library with actionable errors and extensible APIs
+1 stars
from 471 · score 0.69
51.twitter / storehaus
Storehaus is a library that makes it easy to work with asynchronous key value stores
+1 stars
from 465 · score 0.69
52.higherkindness / droste
recursion schemes for cats; to iterate is human, to recurse, divine
- scala
- recursion-schemes
- functional-programming
+1 stars
from 395 · score 0.69
53.neo4j / neo4j-spark-connector
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
- bolt
- hacktoberfest
+1 stars
from 323 · score 0.69
+1 stars
from 245 · score 0.69
55.lolgab / snunit
Scala Native HTTP server based on FreeUnit
- nginx-unit
- scala-native
- http-server
- scala
- serverless
- cask
- +3 more
+1 stars
from 148 · score 0.69