Repository Index

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

• ray
• distributed
• parallel
• machine-learning

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

• database
• distributed-database
• distributed-sql-database
• sql

Apache Hadoop

• hadoop

Apache Beam is a unified programming model for Batch and Streaming data processing.

• python
• java
• big-data
• beam

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

• java
• hazelcast
• in-memory
• big-data

Apache Ignite

• distributed-sql-database
• iot
• osgi
• network-client

Run MapReduce jobs on Hadoop or Amazon Web Services

A cluster computing framework for processing large-scale geospatial data

• cluster-computing
• spatial-sql
• geospatial
• spatial-analysis

Map-Reduce for Clojure

Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.

• apache-iceberg
• apache-spark
• data-engineering
• delta-lake

Distributed Temporal Graph Analytics with Apache Flink

• graph
• property-graph
• distributed-graph-analytics
• apache-flink

Distribute work across machines using the lparallel API.

Serverless ML Framework

• serverless
• machine-learning
• distributed-systems
• jupyter-notebook

Tuple MapReduce for Hadoop: Hadoop API made easy

The core libraries of the teknek stream processing platform