Repository Index

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java

A modern replacement for Redis and Memcached

• memcached
• multi-threading
• redis
• cpp

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

• redash
• python
• visualization
• analytics

Apache Flink

• scala
• java
• big-data
• flink

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

• iot
• bigdata
• time-series
• database

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

• notebooks
• python
• data-science
• machine-learning

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

• data
• pipeline
• data-analysis
• data-engineering

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

• database
• distributed-database
• distributed-sql-database
• sql

🏆 Real-Time no-code, powerful and secure ORM 🚀 providing APIs and Docs without coding by Backend, and Frontend(Client) can customize response JSONs 🏆 实时 零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构

• postgresql-database
• tidb
• sqlserver
• oracle

QuestDB is a high performance, open-source, time-series database

• time-series
• low-latency
• database
• sql

The official home of the Presto distributed SQL query engine for big data

• java
• presto
• hive
• hadoop

Apache Doris is a real-time analytics and hybrid search database for AI agents.

• olap
• database
• hudi
• iceberg

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

• flink
• kafka
• elasticsearch
• spark

C++ Parallel Computing and Asynchronous Networking Framework

• tasking
• http
• redis
• mysql

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

• java
• presto
• hive
• hadoop

mall学习教程，架构、业务、技术要点全方位解析。mall项目（60k+star）是一套电商系统，使用现阶段主流技术实现。涵盖了SpringBoot、MyBatis、Elasticsearch、RabbitMQ、Redis、MongoDB、MySQL等技术，采用Docker容器化部署。

• springboot
• mybatis
• elasticsearch
• rabbitmq

mall-swarm是一套微服务商城系统，采用了 Spring Cloud Alibaba、Spring Boot 3.5、Sa-Token、MyBatis、Elasticsearch、Docker、Kubernetes等核心技术，同时提供了基于Vue的管理后台方便快速搭建系统。mall-swarm在电商业务的基础集成了注册中心、配置中心、监控中心、网关等系统功能。

• springcloud
• springboot
• docker
• java

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

• relational-database
• message-broker
• hadoop-ecosystem
• nosql

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

• database
• olap
• sql
• analytics

PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

• data
• pipeline
• sql

Python SQL Parser and Transpiler

• transpiler
• sql
• python
• parser

BullMQ - Message Queue and Batch processing for NodeJS, Python, .NET, Elixir, Rust and PHP based on Redis or PostgreSQL

• background-jobs
• nodejs
• queue
• redis

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

• database
• stream-processing
• rust
• postgresql

Apache Beam is a unified programming model for Batch and Streaming data processing.

• python
• java
• big-data
• beam