Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
Repository Index
47,133 repositories indexed
1–5 of 5 · Most stars
YAS3FS (Yet Another S3-backed File System) is a Filesystem in Userspace (FUSE) interface to Amazon S3. It was inspired by s3fs but rewritten from scratch to implement a distributed cache synchronized by Amazon SNS notifications. A web console is provided to easily monitor the nodes of a cluster.
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
- ipfs
- warc
- wayback
- web-archiving
Continuous Delivery of static websites to IPFS
- ipfs
- continuous-delivery
- python
Docker image to host IPFS HTTP gateway with support for pin listing and easily adding content