Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
- fluentd
- c
- logging
- data-collector
Repository Index
70,234 visible repositories in the index
1–24 of 32 · Most stars
A unified ecosystem and workspace for large-scale federated learning, bridging the gap between centralized model evolution and decentralized edge intelligence.
A lightweight message queue. Like AWS SQS and RSMQ but on Postgres.
A lightweight data processing framework built on DuckDB and 3FS.
- data-processing
- duckdb
🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines
- rag
- chonkie
- chunker
- chunking-algorithm
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
- bigquery
- copy-database
- data-ingestion
- data-integration
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
An ultra-lightweight and blazing-fast Messaging Bus/MQTT Broker for Edge & SDV
- mqtt
- mqtt-broker
- iot-edge
- nng
Java MQTT lightweight broker
- broker
- mqtt
- java
- moquette
A lightweight stream processing library for Go
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
- etl
- data-integration
- python
- postgresql
[Go] Lightweight eventbus with async compatibility for Go
- event-driven
- golang
Lightweight data stream processing engine for IoT edge
Lightweight and extensible compatibility layer between dataframe libraries!
A lightweight, high-performance go mqtt server(v3.0|v3.1.1|v5.0) supporting distributed cluster
Lightweight real-time big data streaming engine over Apache Pekko
- akka
- stream-processing
- bigdata
- scala
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
- go
- data-integration
- etl
- data-pipeline
Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match
PipelinR is a lightweight command processing pipeline ❍ ⇢ ❍ ⇢ ❍ for your Java awesome app.
- java
- architecture
- service-layer
- pipes-and-filters
Haskell on Apache Spark.
- apache-spark
- spark
- haskell
- analytics
Lightweight and Extensible Infrastructure for Building Web Applications - Web Application Framework
- dotnet-core
- efcore
- aspnet-core
- solid
Lightweight stream processing engine for IoT
A lightweight Reactive Streams Infrastructure Toolkit for Scala.