Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
A Python module to bypass Cloudflare's anti-bot page.
- cloudflare
- anti-bot-page
- protected-page
- scrape
Intelligent web page comparison tool with Wayback Machine support and visual regression testing
- visual-comparison
- wayback-machine
- web-scraping
- diff