1.DataExpert-io / data-engineer-handbook
This is a repo with links to everything you'd ever want to learn about data engineering
+308 stars
from 44,614 · score 5.73
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
35 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
2.ClickHouse / ClickHouse
ClickHouse® is a real-time analytics database management system
+113 stars
from 50,595 · score 4.74
3.marimo-team / marimo
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
+79 stars
from 23,318 · score 4.38
4.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+69 stars
from 44,313 · score 4.25
5.trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
+25 stars
from 13,365 · score 3.26
6.apache / doris
Apache Doris is a real-time analytics and hybrid search database for AI agents.
+22 stars
from 16,140 · score 3.14
7.tobymao / sqlglot
Python SQL Parser and Transpiler
+22 stars
from 9,721 · score 3.14
8.questdb / questdb
QuestDB is a high performance, open-source, time-series database
+20 stars
from 17,473 · score 3.04
9.StarRocks / starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
+19 stars
from 12,206 · score 3.00
10.evidence-dev / evidence
Business intelligence as code: build fast, interactive data visualizations in SQL and markdown
+19 stars
from 7,060 · score 3.00
+16 stars
from 26,424 · score 2.83
12.taosdata / TDengine
High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios
+13 stars
from 25,169 · score 2.64
13.apache / beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
+12 stars
from 8,692 · score 2.56
14.ibis-project / ibis
the portable Python dataframe library
+9 stars
from 6,679 · score 2.30
15.bruin-data / bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
+9 stars
from 1,789 · score 2.30
16.cloudquery / cloudquery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
+8 stars
from 6,542 · score 2.20
17.apache / datafusion-ballista
Apache DataFusion Ballista Distributed Query Engine
+7 stars
from 2,157 · score 2.08
18.ArroyoSystems / arroyo
Distributed stream processing engine in Rust
+6 stars
from 5,067 · score 1.95
19.timeplus-io / proton
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
+6 stars
from 2,274 · score 1.95
20.PRQL / prql
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
+5 stars
from 10,931 · score 1.79
21.MaterializeInc / materialize
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
+4 stars
from 6,388 · score 1.61
22.apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
+4 stars
from 2,371 · score 1.61
23.apache / shardingsphere
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
+3 stars
from 20,813 · score 1.39
24.prestodb / presto
The official home of the Presto distributed SQL query engine for big data
+3 stars
from 16,762 · score 1.39
25.apache / ignite
Apache Ignite
+3 stars
from 5,088 · score 1.39
26.dathere / qsv
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
+3 stars
from 3,815 · score 1.39
27.PeerDB-io / peerdb
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
+3 stars
from 3,310 · score 1.39
28.apache / cloudberry
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
+3 stars
from 1,435 · score 1.39
29.apache / linkis
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
+2 stars
from 3,414 · score 1.10
30.pipelinedb / pipelinedb
High-performance time-series aggregation for PostgreSQL
+2 stars
from 2,665 · score 1.10
31.lf-edge / ekuiper
Lightweight data stream processing engine for IoT edge
+2 stars
from 1,743 · score 1.10
32.pmacct / pmacct
pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
+2 stars
from 1,255 · score 1.10
33.nnnkkk7 / snowflake-emulator
A lightweight Snowflake emulator built with Go and DuckDB for local development and testing
+2 stars
from 55 · score 1.10
34.FeatureBaseDB / featurebaseArchived
A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase
+1 stars
from 2,524 · score 0.69
35.arkflow-rs / arkflow
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
+1 stars
from 1,314 · score 0.69