The headless browser for AI agents and web scraping
- antidetect
- antidetect-browser
- browser
- browser-automation
142,187 visible repositories in the index
1–24 of 24 · Most stars
The headless browser for AI agents and web scraping
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
Foundational low latency web data collecting in Rust
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
HTML parsing and querying with CSS selectors
Trap AI web scrapers in an endless poison pit.
Fast proxy scraper and checker written in Rust. Collects HTTP, SOCKS4 and SOCKS5 proxies from any number of sources, verifies each one really works, and writes JSON and plain text with response time, exit IP, ASN and geolocation. Single binary for Windows, Linux, macOS, Android, FreeBSD, NetBSD, illumos and Solaris, with an interactive TUI.
The repository host gives no description.
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
modular service framework to move and transform network packets
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
An ergonomic, privacy-aware Rust HTTP Client
A Rust library to extract useful data from HTML documents, suitable for web scraping.
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).
Terminal-based manga reader and downloader with image rendering support
Suck the InTernet
crawl and scrape web pages in rust
operative framework is a rust investigation OSINT framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.
📸 Screen capture made easy!
HTTP client that can impersonate web browsers
Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, verifiable data graphs, and evidence-grounded AI context.
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
Search and read the web for AI agents at 99% fewer tokens. Free CLI + MCP.