Repository Index

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

• machine-learning
• python
• data-engineering
• distributed-computing

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

• arrow
• big-data
• pyspark
• rust

The official repository for ROOT: analyzing, storing and visualizing big data, scientifically

• data-analysis
• root-cern
• root
• c-plus-plus

A cluster computing framework for processing large-scale geospatial data

• cluster-computing
• spatial-sql
• geospatial
• spatial-analysis

Essential Spark extensions and helper methods ✨😲

• spark
• dataframe

Python MapReduce library written in Cython. Visit us in #hadoopy on freenode. See the link below for documentation and tutorials.