1.firecrawl / firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
+2,346 stars
from 195,330 · score 7.76
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
29 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
2.D4Vinci / Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
+2,042 stars
from 89,702 · score 7.62
3.lexmount / moli
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
+1,339 stars
from 20,665 · score 7.20
4.JCodesMore / ai-website-cloner-template
Clone any website with one command using AI coding agents
+993 stars
from 37,372 · score 6.90
5.browser-use / browser-use
Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
+640 stars
from 119,125 · score 6.46
6.unclecode / crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
+461 stars
from 86,261 · score 6.14
7.liuda30201 / AI-Coding
AI 编程福利导航：汇总 Claude Code、Codex、Cursor 中转站与公益站，整理免费额度、注册福利、签到活动和评测记录，提供可视化看板与 Python 数据采集工具。
+224 stars
from 375 · score 5.42
8.ScrapeGraphAI / Scrapegraph-ai
Python scraper based on AI
+202 stars
from 32,220 · score 5.31
9.CloakHQ / CloakBrowser
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.
+185 stars
from 32,493 · score 5.23
10.Evil0ctal / Douyin_TikTok_Download_API
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
+173 stars
from 20,895 · score 5.16
11.jo-inc / camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
+151 stars
from 11,951 · score 5.02
12.dgtlmoon / changedetection.io
Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring—all for free or enjoy our SaaS plan!
+143 stars
from 35,291 · score 4.97
13.everyinfra / everyinfra-agent-plugins
EveryInfra MCP server & agent plugin: scraper API for TikTok, Instagram, Amazon, YouTube, Xiaohongshu & Douyin. 573 data APIs across 106 platforms, from $0.56/1K calls. For Claude Code, Cursor, Codex.
+140 stars
from 54 · score 4.95
14.scrapy / scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
+138 stars
from 65,024 · score 4.93
15.MODSetter / SurfSense
Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9
+106 stars
from 16,603 · score 4.67
16.browserbase / stagehand
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
+93 stars
from 25,806 · score 4.54
17.getmaxun / maxun
Turn any website into a structured API. Extract, automate, search and monitor the web.
+89 stars
from 18,040 · score 4.50
18.YOLOW92 / pagesift
Rust web scraper & crawler for AI agents: URLs, PDFs and Office files → clean Markdown/JSON. Firecrawl- and Jina Reader-compatible API, MCP server, Python/Node SDKs. Self-hosted single binary.
+85 stars
from 98 · score 4.45
19.seleniumbase / SeleniumBase
📊 APIs for Web Scraping, Browser Automation, and E2E Testing. CDP Mode bypasses bot-detection and handles CAPTCHAs. Adds stealth to Playwright. Includes an MCP server.
+53 stars
from 13,165 · score 3.99
20.apify / crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
+47 stars
from 26,264 · score 3.87
21.yusufkaraaslan / Skill_Seekers
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
+43 stars
from 15,220 · score 3.78
22.nanobrowser / nanobrowser
Open-source AI agent for web automation. Use your real, logged-in browser to automate daily tasks.
+34 stars
from 14,179 · score 3.56
23.adbar / trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
+28 stars
from 7,022 · score 3.37
24.feder-cr / invisible_playwright
Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
+28 stars
from 2,520 · score 3.37
25.NopeCHALLC / nopecha-extension
Automated CAPTCHA solver for your browser. Works with Selenium, Puppeteer, Playwright, and more.
+23 stars
from 11,060 · score 3.18
26.orangecoding / fredy
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt, eBay Kleinanzeigen and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)
+11 stars
from 1,596 · score 2.48
27.go-rod / rod
A Chrome DevTools Protocol driver for web automation and scraping.
+6 stars
from 7,137 · score 1.95
28.zoharbabin / web-researcher-mcp
Search the web and primary sources, read full pages, and check every citation. MCP server for Claude, Cursor, Codex and more. Runs on your machine.
+5 stars
from 70 · score 1.79
29.xberg-io / crawlberg
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
+4 stars
from 191 · score 1.61