Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
- telegraf
- monitoring
- time-series
- metrics
Repository Index
47,133 repositories indexed
1–24 of 30 · Most stars
GoDS (Go Data Structures) - Sets, Lists, Stacks, Maps, Trees, Queues, and much more
- go
- golang
- data-structure
- map
Workflow Engine for Kubernetes
- workflow
- kubernetes
- argo
- dag
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Fancy stream processing made operationally mundane
- message-queue
- stream-processing
- streaming-data
- message-bus
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
lakeFS - Data version control for your data lake | Git for data
- data-engineering
- data-versioning
- go
- object-storage
Where data access meets operational intelligence
- mysql
- postgresql
- ai-agent
- data-catalog
Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.
- cron
- workflow-engine
- workflow-scheduler
- workflow-orchestration
Privacy and Security focused Segment-alternative, in Golang and React
- privacy
- warehouse-management
- data-warehouse
- customer-data
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
- bigquery
- copy-database
- data-ingestion
- data-integration
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
- etl
- sql
- bigquery
- cloud-native
KubeBlocks is a Kubernetes Operator designed to manage a variety of databases and streaming systems, including MySQL, PostgreSQL, MongoDB, Redis, RabbitMQ, RocketMQ, and more, within Kubernetes environments.
- mysql-operator
- mongodb-operator
- postgresql-operator
- rabbitmq-operator
A lightweight stream processing library for Go
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
- analytics
- bigquery
- data-modeling
- data-pipelines
Lightweight data stream processing engine for IoT edge
Data structure and algorithm library for go, designed to provide functions similar to C++ STL
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
- go
- data-integration
- etl
- data-pipeline
Embeddable and distributed in-memory alternative to Redis.
- cluster
- database
- distributed
- memory
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
go-etl is a toolset for data extraction, transformation and loading.
Machine is a workflow/pipeline library for processing data
- golang
- golang-library
- golang-package
- workflow
A Kafka log inspired in-memory and append-only data structure
Apache Calcite Go
- geospatial
- calcite
- java
- big-data