Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
Repository Index
47,133 repositories indexed
1–2 of 2 · Most stars
Rust web scraper & crawler for AI agents: URLs, PDFs and Office files → clean Markdown/JSON. Firecrawl- and Jina Reader-compatible API, MCP server, Python/Node SDKs. Self-hosted single binary.
- ai-agents
- browser-automation
- data-extraction
- firecrawl