Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
Repository Index
55,640 visible repositories in the index
25–48 of 220 · Most stars
In-memory dimensional time series database.
A Scala API for Cascading
Generic programming for Scala
- scala
- typelevel
- functional-programming
- generic-programming
In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.
- scala
- sqs-interface
- elasticmq
- amazon-sqs
REST job server for Apache Spark
A better build tool for Java, Scala and Kotlin: Simpler than Maven, easier than Gradle, with 3-7x faster dev workflows than other JVM build tools
- scala
- build-tool
- build-system
- java
Wonderful reusable code from Twitter
- finagle
- scala
- utility
Scala Scripting
Yet another JSON library for Scala
- json
- generic-derivation
- scala
Steam Play for macOS
Compositional, streaming I/O library for Scala
- scala
- stream
- streaming-computation
- fp
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Pure Scala Artifact Fetching
- scala
- sbt-plugin
- launcher
- scalajs
Scaloid makes your Android code easy to understand and maintain.
- scala
Property-based testing for Scala
- scala
- scalacheck
- property-testing
Scala GraphQL implementation
Apache Spark to Apache Cassandra connector
Asynchronous, Reactive Programming for Scala and Scala.js.
- scala
- monix
- typelevel
- functional-programming
Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala
- actor-model
- cloud-native
- concurrency
- distributed-actors
A data access library for Scala + Postgres.
- scala
- postgres
- functional-programming
- cats
Base classes to use when writing tests with Spark
MLeap: Deploy ML Pipelines to Production
- scikit-learn
- spark
- data-pipelines
- transformers
Code to accompany Advanced Analytics with Spark from O'Reilly Media