TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
142,273 visible repositories in the index
1–24 of 82 · Most stars
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
webhook is a lightweight incoming webhook server to run shell commands
RobotGo, Go Native cross-platform RPA, GUI automation, Auto test and Computer use @vcaesar
High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Pholcus is a distributed high-concurrency crawler software written in pure golang
A Chrome DevTools Protocol driver for web automation and scraping.
A flexible event/agent & automation system with lots of bees 🐝
Automate Docker container image updates
🔍 gowitness - a golang, web screenshot utility using Chrome Headless
Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.
Shadow any website for offline viewing, with the JavaScript stripped out
✨ A complete and self-contained solution for developers of any qualification to create a production-ready project with backend (Go), frontend (JavaScript, TypeScript) and deploy automation (Ansible, Docker) by running only one CLI command.
Event-driven Automation Framework for Kubernetes
TranslatedXianyu (Idle Fish) multi-account automatic shipping and message reply system, built with Go and React
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
Web Scraper in Go, similar to BeautifulSoup
The most powerful Discord selfbot written in GO allowing users to automate their campaigns & send low-cost mass messages to Discord users!
A telegram bot that will give instant stream links for telegram files without the need of waiting till the download completes. (Telegram File Stream Bot)
A Matrix-WhatsApp puppeting bridge
Agent for Telegram, Discord, Slack, Lark(飞书),dingding(钉钉), 企业微信, QQ, 微信(wechat)
Whatomate is an open-source WhatsApp integration