Trending repositories

Ranked by Attention Score: stars gained over the last 90 complete days

Period

Sort order

Tags: Web scraper

1.firecrawl / firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

ai
crawler
markdown
scraper
html-to-markdown
llm
+13 more

TypeScript AGPL-3.0199K total10K forks

+37,838 stars

from 160,819 · score 10.54

2.DIYgod / RSSHub

🧡 Everything is RSSible

rss
twitter
weibo
bilibili
wechat
zhihu
+13 more

TypeScript AGPL-3.047K total10K forks

+1,443 stars

from 45,376 · score 7.28

3.getmaxun / maxun

Turn any website into a structured API. Extract, automate, search and monitor the web.

automation
no-code
scraper
web-scraper
web-scraping
api
+12 more

TypeScript AGPL-3.018K total1.6K forks

+1,165 stars

from 16,984 · score 7.06

4.dondai44423 / donsetch

Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.

agpl
ai-agents
anti-bot
crawling
mcp
pdf
+3 more

Rust AGPL-3.0970 total64 forks

+970 stars

from 0 · score 6.88

5.eskerda / pybikes

bike sharing + python = pybikes

Python AGPL-3.0609 total180 forks

+4 stars

from 605 · score 1.61

Order: Attention Score

Most net stars gained in the window first. The score only puts this gain on a log scale, so the order is the order of the gain.

How the ranking works

Ranked by stars gained in the window. The score is the natural log of one plus that gain, so a repository's rank is exactly its star gain's rank.

score = log1p(net stars gained in the trailing T complete UTC days)

A repository is ranked only when its Star History covers every day of the window and its latest Observation is not missing.

The longest window is 180 days. Star History from the Repository Host goes back at most 180 days before the first daily record that AwesomeRepos made for the repository. A longer window needs more of these daily records first. A repository younger than the window does not rank in it.

The filters select from the same eligible repositories. A repository matches the topics when it has any of them. Total stars is the count now. Last push and creation on the Repository Host count back from the start of today (UTC). The counts beside the languages, licenses, and topics include all ranked repositories in the window. A Tag holds the repositories that have it. See Tags.

A new repository enters the index when it gains stars faster than the published admission threshold, whatever its size. A repository stays in the index after it enters. Thus an archived repository can still rank.

Browse the Repository Index