Repository Index

A lightweight Reactive Streams Infrastructure Toolkit for Scala.

Bots-as-a-Service for Slack

Redis is an in-memory database that persists on disk. The data model is key-value, but many different kind of values are supported: Strings, Lists, Sets, Sorted Sets, Hashes, Streams, HyperLogLogs, Bitmaps.

Machine is a workflow/pipeline library for processing data

• golang
• golang-library
• golang-package
• workflow

Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching

• serverless-framework
• streaming
• stream-processing
• qt

An opinionated Elixir wrapper around brod, the Erlang Kafka client, that supports encrypted connections to Heroku Kafka out of the box.

• elixir
• kafka

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving

websocket based messaging server written in golang

Reactive queryable observable framework.

• reactive
• rx
• qbservable
• observable

The repository host gives no description.

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

• spark
• hadoop
• webarchives
• analysis

Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.

RDF-Centric Map/Reduce Framework and Freebase data conversion tool

Analyse GTFS Schedule data by importing it into a PostgreSQL database.

• gtfs
• postgresql
• postgres
• sql

STOMP client for Embarcadero Delphi and FreePascal.

• stomp
• delphi
• activemq
• pascal

Real-time decision features without streaming infra. Turn live events into product reflexes — no Kafka, no Flink, no feature store.

• analytics
• feature-store
• fraud-detection
• python

A set of .NET projection libraries

• event-sourcing
• c-sharp
• sql
• projections

Scalable Full History API Solution for Antelope (former EOSIO) based blockchains

• antelope
• api
• big-data
• blockchain

Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.

Friendly utility to load your on-prem data, whether large or small, to Einstein Analytics Datasets, with useful features such as autoloading, dataflow control and dataset inspection.

Kotlin coroutine based library for RabbitMQ

• rabbitmq
• rabbitmq-client
• kotlin
• coroutines

A message queue framework, with support for middleware and multiple adapters.

• elixir
• message-queue

A high performance data transfer tool that can be used to transfer data from Bitcoin Core blockchain files to a SQL Server database

• bitcoin

This is a library that provides generic functionalities for the implementation of imports. In addition to maximum performance and optimized memory consumption, Pacemaker can also be used to implement imports in distributed scenarios that place the highest demands on speed and stability.

• magento
• import
• products
• categories