Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
Repository Index
76,855 visible repositories in the index
1–24 of 92 · Most stars
Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
- scala
- scala-compiler
- scala-programming-language
- scala-library
The Community Maintained High Velocity Web Framework For Java and Scala.
- scala
- java
- reactive
- web-framework
CMAK is a tool for managing Apache Kafka clusters
A Git platform powered by Scala with easy installation, high extensibility & GitHub API compatibility
- scala
- gitbucket
- git
- scalatra
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
Your favorite language gets closer to bare metal.
- scala
- native
- aot
- llvm
ZIO — A type-safe, composable library for async and concurrent programming in Scala
- effects
- concurrency
- asynchronicity
- functional-programming
Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules
- chronos
- mesos
- job-scheduler
- scheduled-jobs
State of the Art Natural Language Processing
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc
- code-analysis
- query-language
- code-browser
- fuzzy-parsing
In-memory dimensional time series database.
Spark: The Definitive Guide's Code Repository
In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.
- scala
- sqs-interface
- elasticmq
- amazon-sqs
Slick (Scala Language Integrated Connection Kit) is a modern database query and access library for Scala
A Scala API for Apache Beam and Google Cloud Dataflow.
- scala
- bigquery
- google-cloud
- beam
深圳地铁大数据客流分析系统🚇🚄🌟
A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine
- ranking
- scala
- search
- personalization
Compositional, streaming I/O library for Scala
- scala
- stream
- streaming-computation
- fp
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Scala language server with rich IDE features 🚀