Sign in

Repository Index

47,133 repositories indexed

Tag: Data pipelines and messaging
Tag
Filters

Filters

Clear all filters

1–16 of 16 · Most stars

Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots

  • chat
  • chat-application
  • chatapp
  • go

A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others

  • java
  • bitset
  • roaring-bitmaps
  • roaringbitmap

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Probabilistic data structures for processing continuous, unbounded streams.

  • bloom-filter
  • go
  • stable-bloom-filters
  • cuckoo-filter

:lipstick: Durable and asynchronous data imports for consuming data at scale and publishing testable SDKs.

  • porter
  • data-import
  • framework
  • data-transformation

The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.

A production-grade HBase ORM library that makes accessing HBase clean, fast and fun (Can also be used as Bigtable ORM)

  • hbase
  • orm
  • mapreduce
  • object-mapping

EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.

  • dotnet
  • dotnet-core
  • etl
  • etl-framework