Repository Index

Crossbar.io - WAMP application router

• websocket
• wamp
• messaging
• mqtt

Barebone MQTT broker that can run on any stream server, the node way

• mqtt
• mqtt-broker
• nodejs
• mqtt-server

Data processing & ETL framework for Ruby

• etl
• etl-ruby
• ruby
• data

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

• spark
• hadoop
• webarchives
• analysis

STOMP client for Embarcadero Delphi and FreePascal.

• stomp
• delphi
• activemq
• pascal

Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.

A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz

• hadoop
• spark
• webarchive
• web-archiving

Partition (W)ARC Files by MIME Type and Year

• web-archiving
• webarchive
• hadoop
• warc