301.smooks / smooks
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
- java
- smooks
- enterprise-integration
- etl
- sax
- pipelines
- +5 more
Ranked by Attention Score: stars gained over the last 180 complete days
301–389 of 389 by Attention Score · May 8, 2026 – Nov 3, 2026 (UTC)
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
Spawn - Actor Mesh
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
🚃 A library for handling mediator patterns and simplified CQRS patterns within an event-driven architecture, inspired by csharp MediatR library.
📜 A CLI toolkit for extracting and working with your digital history
Real-time P2P messenger using go-ipfs pubsub. TUI. End-to-end encrypted texting & file-sharing. NAT traversal.
Formal specification and generation of verifiable binary parsers, message generators and protocol state machines
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.
Declarative data quality engine. Define checks in YAML, run anywhere.
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
Esper Complex Event Processing, Streaming SQL and Event Series Analysis
Performant pure-PHP AMQP (RabbitMQ) sync/async (ReactPHP) library
pyspark methods to enhance developer productivity 📣 👯 🎉
JSON-RPC 2.0 implementation over WebSockets for Node.js and JavaScript/TypeScript
Booster Framework
A state-of-the-art distributed system using Reactive DDD as uncertainty modeling, Event Storming as subdomain decomposition, Event Sourcing as an eventual persistence mechanism, CQRS, Async Projections, Microservices for individual deployable units, Event-driven Architecture for efficient integration, and Clean Architecture as domain-centric design
Highly optimized, extremely modular and very flexible XMPP/Jabber server
AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.
k6 extension to load test Apache Kafka with support for various serialization formats, SASL, TLS, compression, Schema Registry client and beyond
Tree diagrams with JavaScript :evergreen_tree: :chart_with_upwards_trend:
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.
Wisp CLI — Interactive trading platform for backtesting and live trading across spot, perpetual futures, options, and prediction markets
Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.
Distributed, masterless, high performance, fault tolerant data processing
Secor is a service implementing Kafka log persistence
Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.
The official C# Client for NATS
Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
adidas group API design guidelines
Silverback is a message bus and broker integration library for .NET. It is designed to simplify event-driven architectures and asynchronous messaging, with first-class support for Apache Kafka and MQTT.
A collection of kafka-resources
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Data-mining and Visualization components for RAD Studio
General-purpose, formally-verified, 64-bit operating system in SPARK/Ada for x86-64
A type-safe queue for background tasks using PocketBase.
Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter
Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant.
A high available,high performance distributed messaging system.
PySpark + Scikit-learn = Sparkit-learn
Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!
The repository host gives no description.
Queue plugin for CakePHP - simple, pure PHP and without dependencies.
Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching
Emissary is simple, yet 🗲FAST🗲 messaging library for decoupling messages (requests and events) and message handlers 🚀
Facilitates simple durable and asynchronous messaging in dotnet apps.
Docs related to DDD-CQRS-ES Discord Community
Distributed batch data processing framework
.NET framework for DDD, CQRS and Event Sourcing.
Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.
Quick integration toolkit for Ixian. Connects apps, IoT devices, AI Agents, and services to the Ixian Platform via REST APIs and message queues (MQTT/RabbitMQ). Provides developers with a simple bridge into secure Ixian communication and Client Discovery.
Data ingestion engine — Singer taps to Parquet in cloud buckets
A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues
Functional API for Microsoft Orleans http://orleanscontrib.github.io/Orleankka
Job Scheduler for IOS with Concurrent run, failure/retry, persistence, repeat, delay and more
Sample implementation and comparison of various approaches to building DDD applications. Useful as a baseline to quickly start a DDD dot net project.
Monad, Functional Programming features for Golang
Serverless proxy for Spark cluster
A pipe-like function to verticalize your JavaScript code
Go simple async message bus
Examples of implementation CQRS with Event Sourcing - evolutionary approach
Machine is a workflow/pipeline library for processing data
Scalable Full History API Solution for Antelope (former EOSIO) based blockchains
A production-grade HBase ORM library that makes accessing HBase clean, fast and fun (Can also be used as Bigtable ORM)
A secure and high performances microkernel for building secure MCU-based IoTs
Mirror of Apache Qpid Broker-J
An Object Pascal Client for NATS
Streaming MapReduce with Scalding and Storm
Distributed Stream and Batch Processing
Livy is an open source REST interface for interacting with Apache Spark from anywhere
CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.
A C# implementation of WAMP (The Web Application Messaging Protocol)
Akka CQRS/ES framework
RSS as RESTful. This service allows you to transform RSS feed into an awesome API.
A sample DDD/CQRS project using KOTLIN :beer:
A Clojure machine learning library
Google Pub/Sub client for Elixir
Ballerina MQTT Module.
Event sourcing implementation sample in F# - Moved to Codeberg
Message Broker for IoT/Mobile/Web. Mainly uses MQTT v3.x and v5. Aims to be easy to use, scalable and reliable
BeanQueue, a lightweight Python task queue framework based on SQLAlchemy, PostgreSQL SKIP LOCKED queries and NOTIFY / LISTEN statements.