1.ssssssss-team / spider-flow新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。spidercrawlerjsoupxpathweb-spiderwebspider+3 moreJavaMIT11K total2.2K forks+60 starsfrom 11,304 · score 4.11
2.apache / stormcrawlerA scalable, mature and versatile web crawler based on Apache Stormweb-crawlerapache-stormdistributedjavacrawlerstormcrawlerJavaAPACHE-2.01K total297 forks+22 starsfrom 989 · score 3.14