60,621 visible repositories in the index
1–24 of 92 · Most stars
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
JavaScript API for Chrome and Firefox
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
Command-line program to download image galleries and collections from several image hosting sites
A next-generation crawling and spidering framework.
Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.
A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
Get the main content of any page as Markdown.
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
Cross-platform library for building Telegram clients
Modern Telegram Bot Framework for Node.js
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
Visual Development for React, Vue, Svelte, Qwik, and more
This is a python API which allows you to get the transcript/subtitles for a given YouTube video. It also works for automatically generated subtitles and it does not require an API key nor a headless browser, like other selenium based solutions do!
🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.
💯 Teach puppeteer new tricks through plugins.