TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
99,825 visible repositories in the index
1–16 of 16 · Most stars
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.
Shadow any website for offline viewing, with the JavaScript stripped out
基于 ZeroBot 的 OneBot 插件
Fast website link checker in Go
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
Web Scraper in Go, similar to BeautifulSoup
Port of Wappalyzer (uncovers technologies used on websites) to automate mass scanning.
Extract structured data from web sites. Web sites scraping.
微信ipad协议(WeChat iPad Protocol,人脸版):云途Auth 人脸验证一码登录,iPad 人脸版/Mac/Linux 多画像登录,WebSocket/HTTP 回调实时消息同步,覆盖好友/群/朋友圈/视频号/企微。微信ipad协议接口(iPad protocol)支持 Docker/Linux/Windows 私有化部署,面向 AI 客服、聚合聊天、私域 SCRM。测试地址联系作者。
Go package for scraping website recipes
Go-native browser automation via Chrome DevTools Protocol. No Node.js, no relay process, no external dependencies.
Go http.Client with a byte-exact browser TLS fingerprint (uTLS) — survive JA3/JA4 blocking without a headless browser.
Open-source real-time Voice AI infrastructure in Go. Stream audio via WebRTC or WebSocket, connect STT → LLM → TTS pipelines, and build scalable voice agents and conversational AI applications.