70,234 visible repositories in the index
1–19 of 19 · Most stars
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Python version of the Playwright testing and automation library.
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
Undetected version of the Playwright testing and automation library.
Headless chrome/chromium automation library (unofficial port of puppeteer)
A node.js library for testing modern web applications
.NET version of the Playwright testing and automation library.
A high-level API to control headless Chrome or Chromium over the DevTools Protocol. It is the Rust equivalent of Puppeteer, a Node library maintained by the Chrome DevTools team.
Java version of the Playwright testing and automation library
Elixir library for writing integration tests and browser automation
Apache Geb: Very Groovy Browser Automation
Playwright PHP library for browser automation: navigation, E2E tests, assertions, screenshots, and so much more!
A JavaScript client library that brings cross-platform consistency to the Selenium WebDriver API.
The AI-native browser automation library. Snapshot + ref targeting — born from OpenClaw, built for agents, by agents.
A runtime library and schema code generation tools for Chrome DevTools Protocol support in C#/.NET.
cl-webdriver-client is a client library for WebDriver (W3C specification).
A high-level API to control headless Chrome or Chromium over the DevTools Protocol. It is the Rust equivalent of Puppeteer, a Node library maintained by the Chrome DevTools team.
Selenium library for Crystal