Parallel computing with task scheduling
- dask
- python
- pydata
- numpy
Repository Index
65,764 visible repositories in the index
1–11 of 11 · Most stars
Enterprise job scheduling middleware with distributed computing ability.
- scheduler
- workflow
- distributed
- mapreduce
A lightweight data processing framework built on DuckDB and 3FS.
- data-processing
- duckdb
A modular implementation of timely dataflow in Rust
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
- distributed-computing
- map-reduce
- golang
- distributed-systems
Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant.
Run MapReduce jobs on Hadoop or Amazon Web Services
A distributed task scheduler for Dask
- pydata
- dask
- distributed-computing
- python
Map-Reduce for Clojure
Python MapReduce library written in Cython. Visit us in #hadoopy on freenode. See the link below for documentation and tutorials.
Tuple MapReduce for Hadoop: Hadoop API made easy