1.lexmount / moli
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
- browser
- rust
- servo
- browser-automation
- playwright
- ai-agents
- +10 more
+1,263 stars
from 21,176 · score 7.14
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
11 repositories by Attention Score · Oct 28, 2026 – Nov 3, 2026 (UTC)
2.unclecode / crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
+439 stars
from 86,411 · score 6.09
3.Evil0ctal / Douyin_TikTok_Download_API
TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
- tiktok
- douyin
- scraper
- crawler
- web-scraping
- tiktok-scraper
- +14 more
+190 stars
from 20,944 · score 5.25
4.dengmeiluan / ticket-monitoring
Translated✈️ Self-hosted multi-channel airfare price monitoring: flight detail collection → DingTalk rich-media push → four-layer strong alerts when the target price is met. Domestic routes and international routes (destinations on five continents) share the same collect-judge-push pipeline; data stays on your own machine, all configuration is done on a web page, open source and free.
- crawler
- dingtalk
- flight
- playwright
- price-monitoring
- python
- +2 more
+172 stars
from 268 · score 5.15
5.apify / crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- web-scraping
- web-crawling
- npm
- headless-chrome
- puppeteer
- automation
- +11 more
+52 stars
from 26,276 · score 3.97
6.adbar / trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
- text-mining
- crawler
- +14 more
+38 stars
from 7,029 · score 3.66
7.jina-ai / reader
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
+30 stars
from 12,200 · score 3.43
8.mozilla / readability
A standalone version of the readability lib
+7 stars
from 11,518 · score 2.08
9.gocolly / colly
Elegant Scraper and Crawler Framework for Golang
+4 stars
from 25,571 · score 1.61
+2 stars
from 16,748 · score 1.10
11.code4craft / webmagic
A scalable web crawler framework for Java.
+2 stars
from 11,670 · score 1.10