SmartCode = IDataSource -> IBuildTask -> IOutput => Build Everything!!!
- code-generator
- etl
- dotnet-core
- dotnet
108,094 visible repositories in the index
73–96 of 100 · Most stars
SmartCode = IDataSource -> IBuildTask -> IOutput => Build Everything!!!
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
The data transformation tool the open-source community deserves.
Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models. Uses RemoteTable gem internally.
A fast to develop, fast to run, Go based toolkit for ETL and feature extraction on Hadoop.
📜 A CLI toolkit for extracting and working with your digital history
go-etl is a toolset for data extraction, transformation and loading.
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
Event-driven OneLake pipeline with automated Upsert merge and Python reporting
Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.
Friendly utility to load your on-prem data, whether large or small, to Einstein Analytics Datasets, with useful features such as autoloading, dataflow control and dataset inspection.
🇪🇺 Warehouse-native Analytics compatible with Google Analytics and Matomo tracking protocols. Ingest into ClickHouse, BigQuery or CSV/Parquet on S3/GCS/local fs while maintaining complete control over your data.
Reverse ETL for the code-first data stack
EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.
Interfaces ham radio APRS-IS servers and saves packet data into an influxdb database
Just swoof it in
Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.
Import to Pocketbase
Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.
Live import all your Google Sheets to your data warehouse
Internet Archive's Sparkling Data Processing Library
High performant ETL engine written in TypeScript
Read JMeter results in a csv file and put results in Influxdb database and allows you to create beautiful graphs with Grafana
ETL scripts for EOS.