Maxwell's daemon, a mysql-to-json kafka producer
Repository Index
47,133 repositories indexed
1–24 of 26 · Most stars
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
- workflow
- governance
- azkaban
- davinci
ZapFast: a fast, native WhatsApp client in Rust and egui
- chat
- desktop-app
- egui
- linux
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
- dataops
- dataops-platform
- elt
- open-source
Barebone MQTT broker that can run on any stream server, the node way
MongooseIM is Erlang Solutions' robust, scalable and efficient XMPP server, aimed at large installations. Specifically designed for enterprise purposes, it is fault-tolerant and can utilise the resources of multiple clustered machines.
- mongooseim
- erlang
- xmpp
- jabber
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
- apache-spark
- big-data
- connected-components
- dataframe
Data structure and algorithm library for go, designed to provide functions similar to C++ STL
Sparkling Water provides H2O functionality inside Spark cluster
- h2o
- spark
- machine-learning
- integration
📈 Collect customer event data from your apps. (Note that this project only includes the API collector, not the visualization platform)
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
- data-analytics
- data-cleaning
- data-cleansing
- data-engineering
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
Lightweight and Extensible Infrastructure for Building Web Applications - Web Application Framework
- dotnet-core
- efcore
- aspnet-core
- solid
The data transformation tool the open-source community deserves.
Silverback is a message bus and broker integration library for .NET. It is designed to simplify event-driven architectures and asynchronous messaging, with first-class support for Apache Kafka and MQTT.
- microservice
- messaging
- kafka
- silverback
StreamFlow™ is a stream processing tool designed to help build and monitor processing workflows.
Machine is a workflow/pipeline library for processing data
- golang
- golang-library
- golang-package
- workflow
Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.
This is a library that provides generic functionalities for the implementation of imports. In addition to maximum performance and optimized memory consumption, Pacemaker can also be used to implement imports in distributed scenarios that place the highest demands on speed and stability.
- magento
- import
- products
- categories
Time-series database and pub/sub messaging server for IoT and real-time devices, in Go: an embeddable storage engine with TTLs, wildcard topics and encryption, and a clustered server over gRPC, TCP and WebSocket with replication and rolling upgrades.
A set of open-source .NET libraries helping with DDD (domain-driven design) and CQRS (command query responsibility segregation).
- ddd
- cqrs
- nhibernate
- asp-net-core
hypermatch is a high-performance ⚡ Go library designed for rapid matching of a large number of rules to events. It processes thousands of events per second 🚀 against extensive rule sets in-memory with minimal latency ⏱️.
- go
- golang
- matching
- matching-engine
provides a Suricata Eve output for Kafka with Suricate Eve plugin
- suricata
- intrusion-detection
A production-grade messaging abstraction for Go. It provides a unified API to decouple business logic from various brokers including Kafka, RabbitMQ, RocketMQ, NATS, Redis, and AWS SQS. Featuring built-in OpenTelemetry integration and engineered for high reliability.