A scalable, mature and versatile web crawler based on Apache Storm
- web-crawler
- apache-storm
- distributed
- java
98,836 visible repositories in the index
865–888 of 1,102 · Most stars
A scalable, mature and versatile web crawler based on Apache Storm
An extensible distributed system for reliable nearline data streaming at scale
R interface for Apache Spark
G3log is an asynchronous, "crash safe", logger that is easy to use with default logging sinks or you can add your own. G3log is made with plain C++14 (C++11 support up to release 1.3.2) with no external libraries (except gtest used for unit tests). G3log is made to be cross-platform, currently running on OSX, Windows and several Linux distros. See Readme below for details of usage.
CometBFT: A distributed, Byzantine fault-tolerant, deterministic state machine replication engine. A fork and successor to Tendermint Core.
Nornicdb is a distributed low-latency, Graph+Vector, Temporal MVCC with all sub-ms HNSW search, graph traversal, and writes. Using Neo4j Bolt/Cypher and qdrant's gRPC means you can switch with no changes while adding intelligent features like schemas, managed embeddings, reranking+llm, GPU accel, Auto-TLP, Policy-based Memory Decay, and MCP server.
A minimal browser for the distributed web (Desktop version)
Distributed machine learning platform
#matrix is the online open-source workplace inspired in sococo.com for distributed teams to have the experience of work together each day, side-by-side. No matter where team members might be. Working in an online workplace is even more productive when people are feeling in the same space.
A distributed MySQL binlog storage system built on Raft
A music player that connects to your cloud/distributed storage.
An agent runtime and tool protocol for principled agent concurrency
Chaos engineering tool for simulating real-world distributed system failures
Source-built, locally bound FailSafe distribution of ARTEX (v0.3.15)
Simple + Powerful interface to the Mnesia Distributed Database 💾
Drop is an open-source game distribution platform.
The ultimate distributed MQTT broker. Handles 100M+ connections and 10M msg/sec with ease. Built on Kafka to provide industrial-grade persistence and eliminate data loss.
Ronin is a Free and Open Source Ruby Toolkit for Security Research and Development. Ronin also allows for the rapid development and distribution of code, exploits, payloads, etc, via 3rd-party git repositories.
Superdesk is an end-to-end news creation, production, curation, distribution, and publishing platform.
GhostDB is a distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale.
This Raspberry Pi distribution for managing Klipper 3D printers with Mainsail provides all you need.
Distributed scalable database
Electron wrapper to build and distribute HTTP Toolkit for the desktop
A normal Neovim distribution