A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
47,133 repositories indexed
1–8 of 8 · Most stars
A next-generation crawling and spidering framework.
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
TranslatedDaidai Didi (带带弟弟, "take little brother along") general-purpose captcha recognition OCR, PyPI version
Translated[Captcha Recognition - Training] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.
captcha break based on opencv2, tesseract-ocr and some machine learning algorithm.
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
Hashcat wrapper to help automate the cracking process
Go cron job scheduler — drop-in replacement for robfig/cron with runtime updates, resilience middleware, and active maintenance