The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
- metadata
- datadiscovery
- dataquality
- data-profiling
Repository Index
47,133 repositories indexed
1–22 of 22 · Most stars
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
- kafka
- cpp
- kubernetes
- go
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml
Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.
- steampipe
- postgresql
- postgresql-fdw
- cloud
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
- camel
- integration
- java
- microservices
Apache Iggy: Hyper-Efficient Message Streaming at Laser Speed
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
- clickhouse
- kakfa
- sql
- redpanda
Eclipse iceoryx™ - true zero-copy inter-process-communication
- iceoryx
- eclipse
- ipc
- inter-process-communication
The fully compliant, embeddable high-performance Go MQTT v5 server for IoT, smarthome, and pubsub
- mqtt
- mqtt-broker
- mqtt-server
- mqtt-smarthome
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
- data-engineering
- data-integration
- data-pipeline
- data-quality
Graph-based security analysis for everyone
Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.
- apache-iceberg
- apache-spark
- data-engineering
- delta-lake
Time-series database and pub/sub messaging server for IoT and real-time devices, in Go: an embeddable storage engine with TTLs, wildcard topics and encryption, and a clustered server over gRPC, TCP and WebSocket with replication and rolling upgrades.
Google Pub/Sub client for Elixir
Multi-core Window-Based Stream Processing Engine
- llvm
- incremental-computation
- aggregation
- stream-processing
Window-Based Hybrid CPU/GPU Stream Processing Engine
- stream-processing
- hybrid
- multicore
- gpu
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
Open source industrial IoT connectivity gateway.
A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.
- anomaly-detection
- bigquery
- cli
- data-engineering
ETL scripts for EOS.
- eos
- eosio
- etl
- apache-beam
Partition (W)ARC Files by MIME Type and Year
- web-archiving
- webarchive
- hadoop
- warc