Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
132,241 visible repositories in the index
1–8 of 8 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Optimized Agentic and LLM Bulk Processing Over Your Data
A privacy-first guardrail for LLMs and RAG pipelines. SurrogateShield detects, redacts, and reconstructs sensitive PII data on the fly while defending against adversarial attacks.
Open source project for data preparation for GenAI applications
AI gets the context. Not your private data. Local-first privacy proxy for browser chat, AI APIs, and coding agents.
Official Repository of "LLM × DATA" Survey Paper
Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"
Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/