A next-generation crawling and spidering framework.
Repository Index
47,133 repositories indexed
1–6 of 6 · Most stars
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
The unix-way web crawler
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Web spider as a service, spider on serverless