Repository Index

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

• database
• distributed-database
• distributed-sql-database
• sql

Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant.

A cluster computing framework for processing large-scale geospatial data

• cluster-computing
• spatial-sql
• geospatial
• spatial-analysis

Haskell on Apache Spark.

• apache-spark
• spark
• haskell
• analytics

Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.

• apache-iceberg
• apache-spark
• data-engineering
• delta-lake

Distribute work across machines using the lparallel API.

Common Lisp distributed computation framework implemented using Swank Client