Sign in

Repository Index

109,091 visible repositories in the index

Tags: Distributed computing
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–24 of 28 · Most stars

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant.

AI based entity resolution, identity resolution, master data management and deduplication at scale for humans and agents

  • fuzzymatch
  • fuzzy-matching
  • deduplication
  • dedupe

C implementation of the Raft Consensus protocol, BSD licensed

  • raft-consensus-algorithm

Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.