Sign in

Repository Index

47,133 repositories indexed

Tags: Data pipelines and messaging
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–24 of 72 · Most stars

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

  • database
  • distributed-database
  • distributed-sql-database
  • sql

The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles

Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots

  • chat
  • chat-application
  • chatapp
  • go

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others

  • java
  • bitset
  • roaring-bitmaps
  • roaringbitmap

A distributed MQTT message broker based on Erlang/OTP. Built for high quality & Industrial use cases. The VerneMQ mission is active & the project maintained. Thank you for your support!

  • mqtt
  • m2m
  • scalable
  • broker

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

A micro library providing Ruby objects with Publish-Subscribe capabilities

  • ruby
  • events
  • publish-subscribe
  • pubsub

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

  • dataops
  • dataops-platform
  • elt
  • open-source

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

Eclipse iceoryx™ - true zero-copy inter-process-communication

  • iceoryx
  • eclipse
  • ipc
  • inter-process-communication

EventMesh is a new generation serverless event middleware for building distributed event-driven applications.

Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)

High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.

  • flow
  • rust
  • rust-lang
  • stream