A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
47,133 repositories indexed
1–3 of 3 · Most stars
A next-generation crawling and spidering framework.
The unix-way web crawler
Antch, a fast, powerful and extensible web crawling & scraping framework for Go