1firecrawl / firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
+2,346 stars
from 195,330 · score 7.76
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
18 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
2D4Vinci / Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
+2,042 stars
from 89,702 · score 7.62
3soxoj / maigret
🕵️♂️ Collect a dossier on a person by username from 6K websites
+245 stars
from 39,361 · score 5.51
4ScrapeGraphAI / Scrapegraph-ai
Python scraper based on AI
+202 stars
from 32,220 · score 5.31
5jo-inc / camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
+151 stars
from 11,951 · score 5.02
6scrapy / scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
+138 stars
from 65,024 · score 4.93
7apify / crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
+47 stars
from 26,264 · score 3.87
8adbar / trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
+28 stars
from 7,022 · score 3.37
9feder-cr / invisible_playwright
Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
+28 stars
from 2,520 · score 3.37
10ultrafunkamsterdam / undetected-chromedriver
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
+11 stars
from 12,884 · score 2.48
11neon-mmd / websurfx
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
+2 stars
from 1,221 · score 1.10
12online-judge-tools / oj
Tools for various online judges. Downloading sample cases, generating additional test cases, testing your code, and submitting it.
+2 stars
from 1,174 · score 1.10
13playwright-php / playwright
Playwright PHP library for browser automation: navigation, E2E tests, assertions, screenshots, and so much more!
+2 stars
from 253 · score 1.10
14gocolly / colly
Elegant Scraper and Crawler Framework for Golang
+1 stars
from 25,570 · score 0.69
15sparklemotion / mechanize
Mechanize is a ruby library that makes automated web interaction easy.
+1 stars
from 4,444 · score 0.69
16php-embed / Embed
Get info from any web service or page
+1 stars
from 2,138 · score 0.69
17elixir-crawly / crawly
Crawly, a high-level web crawling & scraping framework for Elixir.
+1 stars
from 1,126 · score 0.69
18sananth12 / ImageScraper
:scissors: High performance, multi-threaded image scraper
+1 stars
from 773 · score 0.69