Repository Index

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

• batch-processing
• kafka
• pathway
• python

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

• apache-spark
• big-data
• connected-components
• dataframe

Data structure and algorithm library for go, designed to provide functions similar to C++ STL

• list
• vector
• deque
• queue

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

• data-analytics
• data-cleaning
• data-cleansing
• data-engineering

A plugin to push to Algolia based on graphQl queries

• gatsby
• algolia
• search
• static-site-generator

Hadoop Data Integration with various databases, ftp servers, salesforce. Incremental update, dedup, append, merge your data on Hadoop.

Enables search with Algolia in Hugo static sites

Algorand's data pipeline framework.