Livy is an open source REST interface for interacting with Apache Spark from anywhere
Repository Index
132,241 visible repositories in the index
25–46 of 46 · Most stars
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simplifies collecting, aggregating, and exporting Spark task/stage metrics, and is designed for practical use by developers and data engineers in interactive analysis, testing, and production monitoring workflows.
- spark
- apache-spark
- performance-troubleshooting
- performance-metrics
Lightweight real-time big data streaming engine over Apache Pekko
- akka
- stream-processing
- bigdata
- scala
Mirror of Apache Toree (Incubating)
- toree
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark
💱 Trading application written in Scala 3 that showcases an Event-Driven Architecture (EDA) and Functional Programming (FP)
- event-driven-architecture
- functional-programming
- fp
- eda
APALACHE: symbolic model checker for TLA+ and Quint
- tlaplus
- tla
- model-checking
- smt
The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.
[unmaintained] Scala wrapper for Apache TinkerPop 3 Graph DSL
- gremlin
- scala
- graph-database
- graph
Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
Serverless proxy for Spark cluster
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
Apache HBase Connectors
- database
- java
- hbase
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
A gatling plugin for running load tests on Apache Dubbo(https://github.com/apache/incubator-dubbo) and other java ecosystem.
- gatling
- dubbo
- java
- load-testing
PMML evaluator library for Apache Spark
A library that brings useful functions from various modern database management systems to Apache Spark
Gatling plugin for Apache Kafka — produce, request-reply, and consume load testing with Avro, Protobuf, and Schema Registry support
- gatling
- kafka
- performance
- performance-testing
An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.
- spark
- tweets
- twitter-data
- twitter-json