TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
95,842 visible repositories in the index
1–8 of 8 · Most stars
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
freehire — the open-source search engine for job seekers
An app that helps you monitor your Kubernetes cluster, debug critical deployments & gives recommendations for standard practices
Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot detection by perfectly mimicking Chrome, Firefox, and Safari at the cryptographic level (JA3/JA4, Akamai fingerprint, header order). Supports HTTP/1.1, HTTP/2, HTTP/3, sessions, cookies, and proxies.
Translated🎮 Update profile README / pinned gist to contain your Steam playtime leaderboard.
A lightweight webhook action engine — execute custom commands, scripts, and forward webhooks based on YAML rules when webhook requests arrive.