A scalable web crawler framework for Java.
Repository Index
47,133 repositories indexed
1–7 of 7 · Most stars
Shattered Pixel Dungeon is an open-source traditional roguelike dungeon crawler with randomized levels and enemies, and hundreds of items to collect and use. It's based on the source code of Pixel Dungeon, by Watabou.
Free database schema discovery and comprehension tool
Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.
A scalable, mature and versatile web crawler based on Apache Storm
Java API For Chrome and Firefox
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.