Translated😮Python simulated login for some large websites, plus some simple web crawlers. I hope they are helpful to you❤️. If you like it, remember to give it a star🌟
- python
- spiders
- selenium
- twitter-bot
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
Voight-Kampff is a Ruby gem that detects bots, spiders, crawlers and replicants