Trending Categories Repositories Insights Dependencies Withheld

Trending Categories Repositories Insights Dependencies Withheld

Trending repositories

Ranked by Attention Score: stars gained over the last 7 complete days

Period

Sort order

Topics: web-crawling

Topics

Search topics

No listed topic matches. Press Enter to filter by “”.

Category

Filters

Apply

Filters

Primary language

License

Total stars

Last push

Created

Archived

Clear all filters

3 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)

Topic: web-crawling

1.lexmount / moli

Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust

browser
rust
servo
browser-automation
playwright
ai-agents
+10 more

Rust APACHE-2.022K total611 forks

+1,339 stars

from 20,665 · score 7.20

2.unclecode / crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf

ai
ai-agents
crawler
data-extraction
llm
markdown
+9 more

Python APACHE-2.087K total9K forks

+461 stars

from 86,261 · score 6.14

3.apify / crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

web-scraping
web-crawling
npm
headless-chrome
puppeteer
automation
+11 more

TypeScript APACHE-2.026K total1.7K forks

+47 stars

from 26,264 · score 3.87

Order: Attention Score

Most net stars gained in the window first. The score only puts this gain on a log scale, so the order is the order of the gain.

How the ranking works

Ranked by stars gained in the window. The score is the natural log of one plus that gain, so a repository's rank is exactly its star gain's rank.

score = log1p(net stars gained in the trailing T complete UTC days)

A repository is ranked only when its Star History covers every day of the window and its latest Observation is not missing.

The longest window is 180 days. Star History from the Repository Host goes back at most 180 days before a repository's first Observation. A longer window needs more days of Observations first. A repository younger than the window is not ranked in it.

The filters narrow the same eligible repositories. A repository matches the topics when it has any of them. Total stars is the count now. Last push and creation on the Repository Host count back from the start of today (UTC). The counts beside the languages, licenses, and topics include all ranked repositories in the window. A Category holds the repositories that its published rules match; see Categories.

Repositories enter the index from the Seed Dataset or by gaining stars faster than the published admission threshold, whatever their size. Admission is permanent, so an archived repository can still rank.

Browse the Repository Index

Trending Categories Repositories Insights Dependencies Withheld Withholding Rule Privacy Send feedback