1.dondai44423 / donsetchWeb fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.agplai-agentsanti-botcrawlingmcppdf+3 moreRustAGPL-3.0966 total63 forks+18 starsfrom 946 · score 2.94
2.xberg-io / crawlbergTurn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.crawlingcsharpelixirffigolangjava+10 moreRustMIT195 total29 forks+4 starsfrom 191 · score 1.61