Elegant Scraper and Crawler Framework for Golang
Repository Index
47,133 repositories indexed
1–9 of 9 · Most stars
A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
A little like that j-thing, only in Go.
- selector-strings
- jquery
- html-parsing
- goquery
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
A Chrome DevTools Protocol driver for web automation and scraping.
- cdp
- chrome-headless
- chrome-devtools
- chrome-devtools-protocol
Fast website link checker in Go
An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.
- telegram
- archive
- wayback-machine
- save-the-internet
htmlquery is golang XPath package for HTML query.
- html
- xpath
- html-parser
- golang
Extract structured data from web sites. Web sites scraping.
- golang
- golang-library
- extract-data
- chrome-fetcher