A comprehensive Spark guide collated from multiple sources that can be referred to learn more about Spark or as an interview refresher.
Repository Index
47,133 repositories indexed
97–120 of 207 · Most stars
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
A command-line tool for launching Apache Spark clusters.
- apache-spark
- ec2
- apache-spark-cluster
- orchestration
Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...
- benchmarks
- low-latency
- streaming
R frontend for Spark
:sparkles: Twinkle interface elements in Swift
- twinkle
- swift
- animation
- tvos
A Clojure DSL for Apache Spark
Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slate workflow by Sam Wasserman), render Qwen-Image-2.1 / FLUX3-K pictures and MiniMax H3 / FastH3 video with sound on TensorFold.
- apple-silicon
- minimax-h3
- mlx
- qwen-image
:sparkles: Modular, scoped CSS with ES6
- css-modules
- csjs
- css-in-js
The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.
GNAT Studio is a powerful and lightweight IDE for Ada and SPARK.
Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
- pandas
- pandas-summary
- dataframes
- data-science
:sparkles: Clarify and beautify your comments and plain text files using boxes and lines.
Stream Data Mining Library for Spark Streaming
This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
Simple authorization gem for GraphQL :lock:
- graphql
- guard
- ruby
- authorization
Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
Haskell on Apache Spark.
- apache-spark
- spark
- haskell
- analytics
A Clojure library for Apache Spark: fast, fully-features, and developer friendly
:sparkles: Modular CSS bundler for browserify
- css
- bundler
- browserify
Generate sparklines ▁▂▃▅▂▇
:sparkles: Smoothly navigate between neovim and terminal multiplexer(s) :sparkles:
DeepSeek-V4.1-Flash-1017 EXL3 on 2x DGX Sparks with TensorFold
▁▂▄▆▇█▇▆▄▂▁