Repository Index

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

• bigquery
• copy-database
• data-ingestion
• data-integration

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

• sql
• spark
• hive
• pyspark

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

• etl
• data-integration
• python
• postgresql

Lightweight and extensible compatibility layer between dataframe libraries!

• cudf
• ibis
• pandas
• polars

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

• go
• data-integration
• etl
• data-pipeline

Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match