1.Panniantong / Agent-Reach
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
+89,400 stars
from 18,203 · score 11.40
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
6 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
2.firecrawl / firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
+83,933 stars
from 113,743 · score 11.34
3.D4Vinci / Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
+46,038 stars
from 45,706 · score 10.74
4.ScrapeGraphAI / Scrapegraph-ai
Python scraper based on AI
+8,199 stars
from 24,223 · score 9.01
5.getmaxun / maxun
Turn any website into a structured API. Extract, automate, search and monitor the web.
+2,725 stars
from 15,404 · score 7.91
6.postmodern / spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
+2 stars
from 834 · score 1.10