Trending repositories

Ranked by Attention Score: stars gained over the last 90 complete days

Period

Sort order

Tags: Web scraper

1.NanmiCoder / MediaCrawler

Python Other license70K total13K forks

+10,407 stars

from 59,838 · score 9.25

2.DedSecInside / TorBot

Dark Web OSINT Tool

tor
tor-network
deepweb
dark-web
psnappz
crawler
+14 more

Python Other license5.2K total779 forks

+679 stars

from 4,483 · score 6.52

3.tidyverse / rvest

Simple web scraping for R

r
web-scraping
html

R Other license1.5K total349 forks

+8 stars

from 1,518 · score 2.20

4.algolia / docsearch-scraper

DocSearch - Scraper

algolia
docsearch
documentation
scraper

Python Other license322 total114 forks

+1 stars

from 321 · score 0.69

Order: Attention Score

Most net stars gained in the window first. The score only puts this gain on a log scale, so the order is the order of the gain.

How the ranking works

Ranked by stars gained in the window. The score is the natural log of one plus that gain, so a repository's rank is exactly its star gain's rank.

score = log1p(net stars gained in the trailing T complete UTC days)

A repository is ranked only when its Star History covers every day of the window and its latest Observation is not missing.

The longest window is 180 days. Star History from the Repository Host goes back at most 180 days before the first daily record that AwesomeRepos made for the repository. A longer window needs more of these daily records first. A repository younger than the window does not rank in it.

The filters select from the same eligible repositories. A repository matches the topics when it has any of them. Total stars is the count now. Last push and creation on the Repository Host count back from the start of today (UTC). The counts beside the languages, licenses, and topics include all ranked repositories in the window. A Tag holds the repositories that have it. See Tags.

A new repository enters the index when it gains stars faster than the published admission threshold, whatever its size. A repository stays in the index after it enters. Thus an archived repository can still rank.

Browse the Repository Index