Repository Index

:leaves: Non-blocking, Reactive MongoDB Driver for Scala

• scala
• reactivemongo
• mongodb
• database

ScalaTags is a small XML/HTML construction library for Scala.

Essential Spark extensions and helper methods ✨😲

• spark
• dataframe

Lightweight real-time big data streaming engine over Apache Pekko

• akka
• stream-processing
• bigdata
• scala

Low-code tool for automating actions on real time data | Stream processing for the users.

• flink
• flink-kafka
• apache-flink
• gui

[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark

BlinkDB: Sub-Second Approximate Queries on Very Large Data.

Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.

Scala library providing "source" metadata to your program, similar to Python's __name__, C++'s __LINE__ or Ruby's __FILE__.

The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.

Stream Data Mining Library for Spark Streaming

[unmaintained] Scala wrapper for Apache TinkerPop 3 Graph DSL

• gremlin
• scala
• graph-database
• graph

Serverless proxy for Spark cluster

• apache-spark
• api
• big-data
• serverless

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

• spark
• neo4j-connector
• cypher
• neo4j-driver

Apache HBase Connectors

• database
• java
• hbase

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

• spark
• hadoop
• webarchives
• analysis

A library that brings useful functions from various modern database management systems to Apache Spark

• spark
• postgres
• presto
• hive

Big Data Science Swiss Army Knife - http://www.tuktu.io --

A Scala Native wrapper of the SQLite C library

• database
• linux
• scala
• sqlite

Exercise used for our recruitment process

immutable primitive array/NonEmptyArray wrapper for Scala

• data-structures
• scala
• primitive-arrays
• scala-js

akka http gremlin 3 websocket connector

• scala
• backpressure
• bulk-loader
• akka-streams

Internet Archive's Sparkling Data Processing Library