1.OpenDCAI / DataFlow
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Ranked by Attention Score: stars gained over the last 180 complete days
14 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Incremental engine for long horizon agents 🌟 Star if you like it!
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Kubernetes-native platform to run massively parallel data/streaming jobs
A light-weight, flexible, and expressive statistical data testing library
Unified querying, transformation, and modification of JSON, TOML, YAML, XML, INI, HCL, KDL and CSV.
A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.
Python Stream Processing
Read and write Excel (.xlsx, .xls), CSV, and ODS files in Java with one line of code. Annotation-based mapping, SAX streaming, built-in validation, 19 type converters, cell styling. A high-performance alternative to Apache POI.
Concurrent and multi-stage data ingestion and data processing with Elixir
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
👾~ music, eternal ~ 👾
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Data policy IN, dynamic view OUT: PACE is the Policy As Code Engine. It helps you to programatically create and apply a data policy to a processing platform like Databricks, Snowflake or BigQuery (or plain 'ol Postgres, even!) with definitions imported from Collibra, Datahub, ODD and the like.