Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Repository Index
47,133 repositories indexed
1–18 of 18 · Most stars
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- data
- data-cleaning
- data-pipelines
- data-processing
A light-weight, flexible, and expressive statistical data testing library
- pandas
- validation
- schema
- dataframes
StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.
- security
- kinesis
- serverless
- terraform
MongooseIM is Erlang Solutions' robust, scalable and efficient XMPP server, aimed at large installations. Specifically designed for enterprise purposes, it is fault-tolerant and can utilise the resources of multiple clustered machines.
- mongooseim
- erlang
- xmpp
- jabber
Data structure and algorithm library for go, designed to provide functions similar to C++ STL
Web tool for Avro Schema Registry |
- schema-registry
- kafka
- avro
Lightweight and Extensible Infrastructure for Building Web Applications - Web Application Framework
- dotnet-core
- efcore
- aspnet-core
- solid
Silverback is a message bus and broker integration library for .NET. It is designed to simplify event-driven architectures and asynchronous messaging, with first-class support for Apache Kafka and MQTT.
- microservice
- messaging
- kafka
- silverback
StreamFlow™ is a stream processing tool designed to help build and monitor processing workflows.
Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.
A tiny wrapper over amqp exchanges and queues 🚌 ✨
- rabbitmq
- eventbus
- microservices
- golang
Distributed batch data processing framework
A set of open-source .NET libraries helping with DDD (domain-driven design) and CQRS (command query responsibility segregation).
- ddd
- cqrs
- nhibernate
- asp-net-core
:droplet: Publish/Subscribe utility module
- elixir
- pubsub
hypermatch is a high-performance ⚡ Go library designed for rapid matching of a large number of rules to events. It processes thousands of events per second 🚀 against extensive rule sets in-memory with minimal latency ⏱️.
- go
- golang
- matching
- matching-engine
Stateful actors on Apache Flink 2.x and Java 21 — durable per-key state, exactly-once messaging, Kafka and Kinesis I/O, Kubernetes-native deployment. Continues the Apache Stateful Functions programming model on the modern Flink line.
- actor-model
- apache-flink
- distributed-systems
- event-driven
Pipeline de ingestão e busca semântica de documentos para RAG — com rate limiting, circuit breaker e fila resiliente.