1.ssssssss-team / spider-flow新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。spidercrawlerjsoupxpathweb-spiderwebspider+3 moreJavaMIT11K total2.2K forks+148 starsfrom 11,216 · score 5.00
2.apache / stormcrawlerA scalable, mature and versatile web crawler based on Apache Stormweb-crawlerapache-stormdistributedjavacrawlerstormcrawlerJavaAPACHE-2.01K total297 forks+39 starsfrom 972 · score 3.69