Sign in

Repository Index

47,133 repositories indexed

Tags: Data pipelines and messaging
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

121–144 of 550 · Most stars

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

A micro library providing Ruby objects with Publish-Subscribe capabilities

  • ruby
  • events
  • publish-subscribe
  • pubsub

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant.

In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.

  • scala
  • sqs-interface
  • elasticmq
  • amazon-sqs

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

  • dataops
  • dataops-platform
  • elt
  • open-source