Repository Index

A general-purpose data analysis engine radically changing the way batch and stream data is processed

• stream-analytics
• analytics
• edge-analytics
• iot

ETL scripts for EOS.

• eos
• eosio
• etl
• apache-beam

Quick integration toolkit for Ixian. Connects apps, IoT devices, AI Agents, and services to the Ixian Platform via REST APIs and message queues (MQTT/RabbitMQ). Provides developers with a simple bridge into secure Ixian communication and Client Discovery.

• api
• encryption
• integration
• iot

GTFS Data Pipeline for TfNSW Bus Datasets

• gtfs
• gtfs-static
• gtfs-realtime
• tfnsw

Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.

• collaborative-editing
• conflict-resolution
• crdt
• data-engineering

AWS_MSK_IAM Authentication Plugin for Broadway Kafka

Open, audit-grade agentic data quality framework with portable industry packs

• agentic-ai
• airflow
• data-engineering
• data-quality

💬 Lightweight AlgoChat client for corvid-agent — GitHub Pages hosted

• algochat
• algorand
• blockchain
• encrypted-messaging

Data ingestion engine — Singer taps to Parquet in cloud buckets

• data
• data-engineering
• data-lake
• duckdb

Json-values allows Java developers to harness the power of persistent data structures when working with JSON data, simplifying complex data manipulation. It provides a purely functional approach to JSON

• functional-programming
• java
• json
• json-generator

A queue-esque data type for purescript.

• handler
• purescript
• async
• purescript-queue

Production-grade Server-Sent Events (SSE) for Fiber v3. Event coalescing, priority lanes, topic wildcards, adaptive throttling, built-in auth, Prometheus metrics, graceful drain.

• event-streaming
• fasthttp
• fiber
• gofiber

Apache Spark Connect Client for C#

• apache
• connect
• dotnet
• grpc

Pipeline de ingestão e busca semântica de documentos para RAG — com rate limiting, circuit breaker e fila resiliente.

• docker
• pipeline
• python
• rag

Spark plugin to retrieve metrics from a variety of cluster resources

• scala
• spark

Partition (W)ARC Files by MIME Type and Year

• web-archiving
• webarchive
• hadoop
• warc

Estimating the number of clusters in a data set via the gap statistic. Implemented in H2O-3

• kmeans
• kmeans-clustering
• clustering
• gap-statistic

Implementation of Partitioning Around Medoids (PAM) in H2O-3

• clustering
• machine-learning
• h2o-3
• java

This is a boilerplate for a DDD / CQRS / Event Sourcing project in GoLang.