Elegant Scraper and Crawler Framework for Golang
Repository Index
132,241 visible repositories in the index
1–15 of 15 · Most stars
A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
Pholcus is a distributed high-concurrency crawler software written in pure golang
- spider
- crowler
TranslatedToday's Hot List (今日热榜), an aggregator website that gets the hot headlines from major popular websites. Written in Go, it uses multiple goroutines to fetch information asynchronously and quickly. Preview: https://mo.fish
- hot
- golang
- spider
- today-s-hot-list
Gospider - Fast web spider written in Go
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
A download tools for clawing the ebooks from internets.
- epub
- golang
- spider
Golang短视频去水印:抖音,皮皮虾,火山,微视,最右,快手,全民小视频,皮皮搞笑,西瓜视频,虎牙,梨视频,acfun,好看视频...
小说下载|小说爬取|起点|笔趣阁|导出Markdown|导出txt|转换epub|广告过滤|自动校对
- biquge
- qidian
- fiction
- novels
:paw_prints: Creeper - The Next Generation Crawler Framework (Go)
OSINT Swiss Army Knife
- go
- golang
- osint
- haveibeenpwnd
The unix-way web crawler
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
- golang
- web-crawler
- crawling
- scraping