:zap: A distributed crawler for weibo, building with celery and requests.
- weibospider
- data-analysis
- python3
- distributed-crawler
98,836 visible repositories in the index
265–288 of 1,102 · Most stars
:zap: A distributed crawler for weibo, building with celery and requests.
A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
Dkron - Distributed, fault tolerant job scheduling system https://dkron.io
TranslatedC++ high-performance distributed server framework, webserver, websocket server, custom tcp_server (including logging module, configuration module, thread module, coroutine module, coroutine scheduling module, IO coroutine scheduling module, hook module, socket module, bytearray serialization, http module, TcpServer module, Websocket module, Https module, etc., Smtp email module, MySQL, SQLite3, ORM, Redis, Zookeeper)
Restate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.
An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang. Zero dependencies.
YouTube (Video) Browser-Extension. [Top1 FOSS.] Enrich your experience & choice! 🧰Smart features📌set & forget📌100s of tweaks. Longest-standing. Join🧩us?👨👩👧👧 ⋮ ⋮ ⋮ ⋮ ⋮ {playback|discovery|extra player buttons|quality|codec|full tab|full screen|no distraction|shorts}
:tulip: Distraction-free writing in Vim
Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.
DistroAV (formerly OBS-NDI): NDI integration for OBS Studio
For automated installation of Hyprland on Arch Linux or any Arch Linux-based distros
Produce redistributable builds of Python
Apache Kvrocks is a distributed key value NoSQL database that uses RocksDB as storage engine and is compatible with Redis protocol.
A raspberrypi distro to display a full page browser on boot
CrateDB is a distributed and scalable SQL database for storing and analyzing massive amounts of data in near real-time, even with complex queries. It is PostgreSQL-compatible, and based on Lucene.
The dynamic infrastructure framework for everybody! Distribute the workload of many different scanning tools with ease, including nmap, ffuf, masscan, nuclei, meg and many more!
:skull: Mac app to block your own access to distracting websites etc for a predetermined period of time. It can not be undone by the app or by a restart – you must wait for the timer to run out.
A distributed unique ID generator inspired by Twitter's Snowflake
Visual analysis and diagnostic tools to facilitate machine learning model selection.
Tdarr - Distributed transcode automation using FFmpeg/HandBrake + Audio/Video library analytics + video health checking (Windows, macOS, Linux & Docker)
System-wide ad-blocker and privacy guard for Windows, macOS and Linux.
Next generation distributed, event-driven, parallel config management!
eBPF Observability - Distributed Tracing and Profiling
Open source APM: OpenTelemetry traces, metrics, and logs