A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
47,133 repositories indexed
1–6 of 6 · Most stars
A next-generation crawling and spidering framework.
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
TranslatedDaidai Didi (带带弟弟, "take little brother along") general-purpose captcha recognition OCR, PyPI version
Translated[Captcha Recognition - Training] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.
captcha break based on opencv2, tesseract-ocr and some machine learning algorithm.
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.