Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
47,133 repositories indexed
1–2 of 2 · Most stars
Utils for streaming large files (S3, HDFS, gzip, bz2...)
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz