Repository Index

IoT Platform Framework

• golang
• iot-platform
• edge-computing
• distributed-systems

🔊Minimalist message bus implementation for internal communication with zero-allocation magic on Emit

• eventbus
• message-bus
• pubsub
• message-broker

Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models. Uses RemoteTable gem internally.

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving

Scramjet Platform is a distributed runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters without exposing network ports to the public internet.

• nodejs
• stream-processing
• transform-as-a-service
• real-time

Web application for distributed compute analysis of Archive-It web archive collections.

Internet Archive's Sparkling Data Processing Library