Repository Index

Graph-based security analysis for everyone

• gcp
• graph
• aws
• security

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

• spark
• neo4j-connector
• cypher
• neo4j-driver

Powerful CSV & Excel Import experience for SaaS 🚀 Save months building data import experience from scratch 💰

• csv-import
• data-import
• data-mapping
• data-review

High performance Kafka consumer for InfluxDB. Supports collectd message formats.

• kafka-influxdb
• kafka-consumer
• logstash
• influxdb

Universal BLE Smart Scale bridge. Captures body composition from Renpho, Xiaomi & 20+ others, syncs to Garmin Connect, Strava, MQTT (Home Assistant), InfluxDB, Webhooks, Ntfy & local files (CSV/JSONL). Headless CLI for Raspberry Pi, Linux, macOS & Windows.

• garmin
• typescript
• mqtt
• ble

A fast to develop, fast to run, Go based toolkit for ETL and feature extraction on Hadoop.

📜 A CLI toolkit for extracting and working with your digital history

• chronicle
• chronicle-etl
• personal-data
• etl

Blockchain Indexing Engine

• polkadot
• substrate
• postgres
• indexing

go-etl is a toolset for data extraction, transformation and loading.

• etl
• mysql
• go
• postgresql

A plugin to push to Algolia based on graphQl queries

• gatsby
• algolia
• search
• static-site-generator

Analyse GTFS Schedule data by importing it into a PostgreSQL database.

• gtfs
• postgresql
• postgres
• sql

Scalable Full History API Solution for Antelope (former EOSIO) based blockchains

• antelope
• api
• big-data
• blockchain

Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.

Friendly utility to load your on-prem data, whether large or small, to Einstein Analytics Datasets, with useful features such as autoloading, dataflow control and dataset inspection.

This is a library that provides generic functionalities for the implementation of imports. In addition to maximum performance and optimized memory consumption, Pacemaker can also be used to implement imports in distributed scenarios that place the highest demands on speed and stability.

• magento
• import
• products
• categories

Database synchronizer for Magento 2 (and Wordpress), based on Magerun2. Keeping development, staging and production in sync easily.

• magento2
• magento
• magerun2
• import

🇪🇺 Warehouse-native Analytics compatible with Google Analytics and Matomo tracking protocols. Ingest into ClickHouse, BigQuery or CSV/Parquet on S3/GCS/local fs while maintaining complete control over your data.

• clickhouse
• ga4
• tracker
• bigquery

A blazing fast fully-automated CSV to database importer

• csv2sql
• csvs
• database
• csv-files

Go tool + library that publishes GIS vector data to GeoServer via PostGIS — walks a directory of shapefile / GeoJSON / GeoPackage / KML, loads each into PostGIS via GDAL/OGR, then registers the resulting tables as GeoServer feature types. Idempotent. Tested on GeoServer 2.27 LTS + 2.28 stable.

• gis
• postgis
• geoserver
• golang

A Substrate indexing framework

• substrate

Enables search with Algolia in Hugo static sites

Track Go benchmark performance over time by storing results in InfluxDB

• benchmark
• influxdb
• golang

An import river similar to the elasticsearch mysql river

Reverse ETL for the code-first data stack

• bigquery
• cli
• data-engineering
• dbt