Repository Index

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

• web-scraping
• web-crawling
• npm
• headless-chrome

Python version of the Playwright testing and automation library.

• playwright
• chromium
• firefox
• webkit

Headless chrome/chromium automation library (unofficial port of puppeteer)

• automation
• puppeteer
• chromium

A node.js library for testing modern web applications

• testing-tools
• headless
• headless-browsers
• headless-chrome

.NET version of the Playwright testing and automation library.

• chrome
• chromium
• firefox
• webkit

Java version of the Playwright testing and automation library

• playwright
• java

Elixir library for writing integration tests and browser automation

Apache Geb: Very Groovy Browser Automation

• apache
• bdd-style-testing-framework
• browser-testing
• devtools

Playwright PHP library for browser automation: navigation, E2E tests, assertions, screenshots, and so much more!

• browser
• browser-automation
• php
• php-browser

A JavaScript client library that brings cross-platform consistency to the Selenium WebDriver API.