High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Repository Index
111,821 visible repositories in the index
1–4 of 4 · Most stars
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Python 3.8+ toolbox for submitting jobs to Slurm
- slurm
- python
- clusters
Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.
- apache-iceberg
- apache-spark
- data-engineering
- delta-lake