Turn any website into a structured API. Extract, automate, search and monitor the web.
- automation
- no-code
- scraper
- web-scraper
Repository Index
82,088 visible repositories in the index
1–3 of 3 · Most stars
Polite, slim and concurrent web crawler.
- crawler
- robots-txt
OnionSearch is a script that scrapes urls on different .onion search engines.
- information-gathering
- osint
- osint-tools
- open-source-intelligence