Repository Index

Scrapy, a fast high-level web crawling & scraping framework for Python.

• python
• scraping
• crawling
• framework

TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.

• webcrawler
• scrapy
• crawlab
• spiders-management

Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler

• go
• golang
• goquery
• colly

Scrapy project for data capture of vgchartz