Repository Index

Ready-to-run Docker images containing Jupyter applications

• notebook
• jupyter
• docker
• jupyterhub

Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.

• big-data
• bigdata
• spark
• spark-sql

The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)

• distributed-storage
• distributed-systems
• vertx
• rxjava

Various Jupyter notebooks about Common Crawl data

• jupyter-notebook
• common-crawl
• aws-athena
• webarchiving