A scalable web crawler framework for Java.
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.
A scalable, mature and versatile web crawler based on Apache Storm