Trending Categories Repositories Insights Dependencies Withheld

Trending Categories Repositories Insights Dependencies Withheld

Trending repositories

Ranked by Attention Score: stars gained over the last 180 complete days

Period

Sort order

Topics: scraping

Topics

Search topics

No listed topic matches. Press Enter to filter by “”.

Category

Filters (1)

Apply

Filters

Primary language

License

Total stars

Last push

Created

Archived

Clear all filters

1 repository by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)

Language: Java
Topic: scraping
Clear all

1.code4craft / webmagic

A scalable web crawler framework for Java.

crawler
java
scraping
framework

Java APACHE-2.012K total4.1K forks

+58 stars

from 11,612 · score 4.08

Order: Attention Score

Most net stars gained in the window first. The score only puts this gain on a log scale, so the order is the order of the gain.

How the ranking works

Ranked by stars gained in the window. The score is the natural log of one plus that gain, so a repository's rank is exactly its star gain's rank.

score = log1p(net stars gained in the trailing T complete UTC days)

A repository is ranked only when its Star History covers every day of the window and its latest Observation is not missing.

The longest window is 180 days. Star History from the Repository Host goes back at most 180 days before a repository's first Observation. A longer window needs more days of Observations first. A repository younger than the window is not ranked in it.

The filters narrow the same eligible repositories. A repository matches the topics when it has any of them. Total stars is the count now. Last push and creation on the Repository Host count back from the start of today (UTC). The counts beside the languages, licenses, and topics include all ranked repositories in the window. A Category holds the repositories that its published rules match; see Categories.

Repositories enter the index from the Seed Dataset or by gaining stars faster than the published admission threshold, whatever their size. Admission is permanent, so an archived repository can still rank.

Browse the Repository Index

Trending Categories Repositories Insights Dependencies Withheld Withholding Rule Privacy Send feedback