Redis-based components for Scrapy.
- scrapy
- crawler
- distributed
- redis
78,351 visible repositories in the index
1–4 of 4 · Most stars
Redis-based components for Scrapy.
Better GitHub statistics images for your profile, with stats from private repos too
Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
Self-hosted manga collection manager with automatic metadata, MyAnimeList import, Docker support, and detailed collection statistics.