Elegant Scraper and Crawler Framework for Golang
Repository Index
132,241 visible repositories in the index
1–22 of 22 · Most stars
A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
Pholcus is a distributed high-concurrency crawler software written in pure golang
- spider
- crowler
TranslatedToday's Hot List (今日热榜), an aggregator website that gets the hot headlines from major popular websites. Written in Go, it uses multiple goroutines to fetch information asynchronously and quickly. Preview: https://mo.fish
- hot
- golang
- spider
- today-s-hot-list
Gospider - Fast web spider written in Go
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
BitTorrent DHT Protocol && DHT Spider.
- dht
- spider
- bittorrent-dht-protocol
- go
Go语言实例教程从入门到进阶,包括基础库使用、设计模式、面试易错点、工具类、对接第三方等
- go
- blockchain
- goutils
- design
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
A download tools for clawing the ebooks from internets.
- epub
- golang
- spider
Golang短视频去水印:抖音,皮皮虾,火山,微视,最右,快手,全民小视频,皮皮搞笑,西瓜视频,虎牙,梨视频,acfun,好看视频...
小说下载|小说爬取|起点|笔趣阁|导出Markdown|导出txt|转换epub|广告过滤|自动校对
- biquge
- qidian
- fiction
- novels
百度云网盘爬虫
:paw_prints: Creeper - The Next Generation Crawler Framework (Go)
Signal 18 repman - Replication Manager for MySQL / MariaDB / Percona Server
- failover
- slave
- leader-election
- mariadb
Underlay and RDMA network solution of the Kubernetes, for bare metal, VM and any public cloud
- golang
- kubernetes
- ipam
- cni
OSINT Swiss Army Knife
- go
- golang
- osint
- haveibeenpwnd
The unix-way web crawler
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
- golang
- web-crawler
- crawling
- scraping
The repository host gives no description.