TranslatedSome interesting examples of python crawlers that are friendly to beginners. Mainly crawls websites such as 淘宝 (Taobao, "searching for treasure"), 天猫 (Tmall, "sky cat"), 微信 (WeChat, "micro message"), 微信读书 (WeChat Reading), 豆瓣 (Douban, "bean petal"), and QQ.
Repository Index
55,640 visible repositories in the index
1–7 of 7 · Most stars
TranslatedPython scripts. Simulated login to Zhihu, web crawlers, working with Excel, WeChat official accounts, remote power-on
List of libraries, tools and APIs for web scraping and data processing.
- web-scraping
- captcha-bypass
- captcha-recaptcha
- crawling
A collection of awesome web crawler,spider in different languages
A curated list of awesome puppeteer resources.
- puppeteer
- headless-chrome
- awesome
- awesome-list
:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Various Jupyter notebooks about Common Crawl data
- jupyter-notebook
- common-crawl
- aws-athena
- webarchiving