The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
- metadata
- datadiscovery
- dataquality
- data-profiling
Repository Index
47,133 repositories indexed
1–18 of 18 · Most stars
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
A light-weight, flexible, and expressive statistical data testing library
- pandas
- validation
- schema
- dataframes
A network event stream processing system, in Clojure.
- riemann
- events
- clojure
- monitoring
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Keep passwords and other sensitive information out of your chat logs and inboxes.
Confluent Schema Registry for Kafka
- schema-registry
- kafka
- schema
- schemas
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
- data
- spark
- java
- iceberg
omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
- transform
- etl
- xml
- json
Karapace - Your Apache Kafka® essentials in one tool
- kafka
- schema-registry
- rest-proxy
Web tool for Avro Schema Registry |
- schema-registry
- kafka
- avro
This is a library that provides generic functionalities for the implementation of imports. In addition to maximum performance and optimized memory consumption, Pacemaker can also be used to implement imports in distributed scenarios that place the highest demands on speed and stability.
- magento
- import
- products
- categories
Build and deploy a serverless data pipeline on AWS with no effort.
- aws-cdk
- data-pipeline
- stepfunctions
- glue
Haskell distributed stream processing with exactly-once semantics
Lightweight DataFrame validation decorators for Pandas, Polars, Modin, and PyArrow. No custom types required.
Queue data structure for Elixir-lang
- hex
- elixir
- queue
- data-structure
Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.
- collaborative-editing
- conflict-resolution
- crdt
- data-engineering
Json-values allows Java developers to harness the power of persistent data structures when working with JSON data, simplifying complex data manipulation. It provides a purely functional approach to JSON
- functional-programming
- java
- json
- json-generator