This is a repo with links to everything you'd ever want to learn about data engineering
Repository Index
47,133 repositories indexed
1–15 of 15 · Most stars
Apache Spark - A unified analytics engine for large-scale data processing
Apache Flink
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
QuestDB is a high performance, open-source, time-series database
Apache Doris is a real-time analytics and hybrid search database for AI agents.
Apache Beam is a unified programming model for Batch and Streaming data processing.
Apache Ignite
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
App to easily query, script, and visualize data from every database, file, and API.
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Apache DataFusion Ballista Distributed Query Engine
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
Apache Calcite Go
Apache AVRO for go