Trending Tags Repositories Insights Dependencies Withheld

/

Trending Tags Repositories Insights Dependencies Withheld

Trending repositories

Ranked by Attention Score: stars gained over the last 30 complete days

Period

Sort order

Topics: webcrawler

Topics

Search topics

No listed topic matches. Press Enter to filter by “”.

Tag

Filters

Apply

Filters

Primary language

License

Total stars

Last push

Created

Archived

Clear all filters

2 repositories by Attention Score · Oct 4, 2026 – Nov 2, 2026 (UTC)

Topic: webcrawler

1.crawlab-team / crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

webcrawler
scrapy
crawlab
spiders-management
go
scrapyd-ui
+7 more

Go BSD-3-CLAUSE12K total1.9K forks

+21 stars

from 12,266 · score 3.09

2.ssssssss-team / spider-flow

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

spider
crawler
jsoup
xpath
web-spider
webspider
+3 more

Java MIT11K total2.2K forks

+19 stars

from 11,345 · score 3.00

Order: Attention Score

Most net stars gained in the window first. The score only puts this gain on a log scale, so the order is the order of the gain.

How the ranking works

Ranked by stars gained in the window. The score is the natural log of one plus that gain, so a repository's rank is exactly its star gain's rank.

score = log1p(net stars gained in the trailing T complete UTC days)

A repository is ranked only when its Star History covers every day of the window and its latest Observation is not missing.

The longest window is 180 days. Star History from the Repository Host goes back at most 180 days before a repository's first Observation. A longer window needs more days of Observations first. A repository younger than the window is not ranked in it.

The filters narrow the same eligible repositories. A repository matches the topics when it has any of them. Total stars is the count now. Last push and creation on the Repository Host count back from the start of today (UTC). The counts beside the languages, licenses, and topics include all ranked repositories in the window. A Tag holds the repositories that have it; see Tags.

Repositories enter the index from the Seed Dataset or by gaining stars faster than the published admission threshold, whatever their size. Admission is permanent, so an archived repository can still rank.

Browse the Repository Index

Trending Tags Repositories Insights Dependencies Withheld Withholding Rule Health facts Privacy Send feedback

Powered by Workhorse · From the makers of AwesomeRepos