Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
47,133 repositories indexed
1–5 of 5 · Most stars
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Ruby and Rails efficient Kafka processing framework
Real-time decision features without streaming infra. Turn live events into product reflexes — no Kafka, no Flink, no feature store.
Friendly utility to load your on-prem data, whether large or small, to Einstein Analytics Datasets, with useful features such as autoloading, dataflow control and dataset inspection.
Haskell distributed stream processing with exactly-once semantics