Repository Index

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

• sql
• spark
• hive
• pyspark

Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant.

Compositional, streaming I/O library for Scala

• scala
• stream
• streaming-computation
• fp

Multi-core Window-Based Stream Processing Engine

• llvm
• incremental-computation
• aggregation
• stream-processing

A library to build and execute typed scientific workflows

• ocaml
• bioinformatics
• computational-biology
• workflow