The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
- claude-code
- codex
- data-processing
- harness-engineering
132,241 visible repositories in the index
25–48 of 94 · Most stars
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
Concurrent and multi-stage data ingestion and data processing with Elixir
Data Contracts engine for the modern data stack. https://www.soda.io
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Collect, aggregate, and visualize a data ecosystem's metadata
jellyfin电影元数据插件
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
Python Stream Processing
Scalable data pre processing and curation toolkit for LLMs
Optimized Agentic and LLM Bulk Processing Over Your Data
Machine learning with dataframes
Extract Transform Load for Python 3.5+
Stream Processing and Complex Event Processing Engine
Python Streaming DataFrames for Kafka
Data and tools for generating and inspecting OLMo pre-training data.
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Concurrent Python made simple
Secure Vault for Customer PII/PHI/PCI/KYC Records
This repository aims to map the ecosystem of artificial intelligence guidelines, principles, codes of ethics, standards, regulation and beyond.
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
visual data prep powered by python
Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.
Automatically find issues in image datasets and practice data-centric computer vision.
bgm.tv plugin for jellyfin