Trending Categories Repositories Insights Dependencies Withheld

Trending Categories Repositories Insights Dependencies Withheld

Trending repositories

Ranked by Attention Score: stars gained over the last 7 complete days

Period

Sort order

Topics: crawler

Topics

Search topics

No listed topic matches. Press Enter to filter by “”.

Category

Filters (1)

Apply

Filters

Primary language

License

Total stars

Last push

Created

Archived

Clear all filters

4 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)

Language: Go
Topic: crawler
Clear all

1.projectdiscovery / katana

A next-generation crawling and spidering framework.

crawler
web-spider
gocrawler
spider-framework
cli
headless
+1 more

Go MIT18K total1.2K forks

+54 stars

from 17,730 · score 4.01

2.iawia002 / lux

👾 Fast and simple video download library and CLI tool written in Go

downloader
go
crawler
scraper
video
bilibili
+7 more

Go MIT32K total3.3K forks

+14 stars

from 31,804 · score 2.71

3.crawlab-team / crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

webcrawler
scrapy
crawlab
spiders-management
go
scrapyd-ui
+7 more

Go BSD-3-CLAUSE12K total1.9K forks

+2 stars

from 12,285 · score 1.10

4.gocolly / colly

Elegant Scraper and Crawler Framework for Golang

golang
scraper
framework
crawler
scraping
crawling
+2 more

Go APACHE-2.026K total1.9K forks

+1 stars

from 25,570 · score 0.69

Order: Attention Score

Most net stars gained in the window first. The score only puts this gain on a log scale, so the order is the order of the gain.

How the ranking works

Ranked by stars gained in the window. The score is the natural log of one plus that gain, so a repository's rank is exactly its star gain's rank.

score = log1p(net stars gained in the trailing T complete UTC days)

A repository is ranked only when its Star History covers every day of the window and its latest Observation is not missing.

The longest window is 180 days. Star History from the Repository Host goes back at most 180 days before a repository's first Observation. A longer window needs more days of Observations first. A repository younger than the window is not ranked in it.

The filters narrow the same eligible repositories. A repository matches the topics when it has any of them. Total stars is the count now. Last push and creation on the Repository Host count back from the start of today (UTC). The counts beside the languages, licenses, and topics include all ranked repositories in the window. A Category holds the repositories that its published rules match; see Categories.

Repositories enter the index from the Seed Dataset or by gaining stars faster than the published admission threshold, whatever their size. Admission is permanent, so an archived repository can still rank.

Browse the Repository Index

Trending Categories Repositories Insights Dependencies Withheld Withholding Rule Privacy Send feedback