A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
Repository Index
60,621 visible repositories in the index
1–13 of 13 · Most stars
A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.
- golang
- chrome
- chrome-debugging-protocol
- testing
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
- browser-automation
- cdp
- golang
- headless-chrome
A Chrome DevTools Protocol driver for web automation and scraping.
- cdp
- chrome-headless
- chrome-devtools
- chrome-devtools-protocol
🔍 gowitness - a golang, web screenshot utility using Chrome Headless
- chrome
- headless
- screenshot
- security
Extract structured data from web sites. Web sites scraping.
- golang
- golang-library
- extract-data
- chrome-fetcher
Android automation from code. Test your apps on real phones, script the tasks you repeat, run a shelf of phones, or let an AI agent use one, from Python, Node.js, the CLI, HTTP or Appium clients. No ADB, no USB cable, no root.
Run a web page like a program
- cross-platform
- golang
- headless-browser
- purego
Go-native browser automation via Chrome DevTools Protocol. No Node.js, no relay process, no external dependencies.
- browser-automation
- cdp
- chrome-devtools-protocol
- golang
Go http.Client with a byte-exact browser TLS fingerprint (uTLS) — survive JA3/JA4 blocking without a headless browser.
- akamai-fingerprint
- anti-bot
- cloudflare-bypass
- go
A lightweight webhook action engine — execute custom commands, scripts, and forward webhooks based on YAML rules when webhook requests arrive.
Lightweight Go SDK for Yandex Messenger Bot API — type-safe client with retry, rate-limit handling, and service-oriented architecture
- api-client
- bot
- bot-api
- chatbot