1.projectdiscovery / katana
A next-generation crawling and spidering framework.
+1,277 stars
from 16,517 · score 7.15
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
7 repositories by Attention Score · May 8, 2026 – Nov 3, 2026 (UTC)
2.gocolly / colly
Elegant Scraper and Crawler Framework for Golang
+436 stars
from 25,139 · score 6.08
3.go-rod / rod
A Chrome DevTools Protocol driver for web automation and scraping.
- cdp
- chrome-headless
- chrome-devtools
- chrome-devtools-protocol
- headless
- web-scraping
- +11 more
+297 stars
from 6,846 · score 5.70
4.crawlab-team / crawlab
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
- go
- scrapyd-ui
- +7 more
+153 stars
from 12,137 · score 5.04
5.PuerkitoBio / goquery
A little like that j-thing, only in Go.
- selector-strings
- jquery
- html-parsing
- goquery
+131 stars
from 14,859 · score 4.88
6.wabarc / wayback
An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.
- telegram
- archive
- wayback-machine
- save-the-internet
- snapshot-webpage
- internet-archive
- +14 more
+80 stars
from 2,170 · score 4.39
+30 stars
from 2,590 · score 3.43