An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Repository Index
78,351 visible repositories in the index
1–24 of 47 · Most stars
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
ZIO — A type-safe, composable library for async and concurrent programming in Scala
- effects
- concurrency
- asynchronicity
- functional-programming
Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules
- chronos
- mesos
- job-scheduler
- scheduled-jobs
State of the Art Natural Language Processing
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc
- code-analysis
- query-language
- code-browser
- fuzzy-parsing
In-memory dimensional time series database.
Generic programming for Scala
- scala
- typelevel
- functional-programming
- generic-programming
Spark: The Definitive Guide's Code Repository
Wonderful reusable code from Twitter
- finagle
- scala
- utility
Slick (Scala Language Integrated Connection Kit) is a modern database query and access library for Scala
Abstract Algebra for Scala
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Fast, testable, Scala services built on TwitterServer and Finagle
- scala
- finagle
- twitter-server
- http
Functional JDBC layer for Scala.
- typelevel
- fp
- functional-programming
- scala
Compile-time Language Integrated Queries for Scala
Feathr – A scalable, unified data and AI engineering platform for enterprise
- feature-engineering
- feature-store
- artificial-intelligence
- mlops
Powerful new number types and numeric abstractions for Scala.
A data access library for Scala + Postgres.
- scala
- postgres
- functional-programming
- cats
Distributed Prometheus time series database
- scala
- time-series
- database
- distributed
Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster
:leaves: Non-blocking, Reactive MongoDB Driver for Scala