Repository Index

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

• web-scraping
• web-crawling
• npm
• headless-chrome

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

• ai-agent
• anti-bot
• antidetect-browser
• automation

Headless Chromium-based web performance metrics collector and monitoring tool

• phantomas
• metrics
• javascript
• css

Efficient embeddable adblocker library

• content-blocking
• javascript
• adblocker
• easylist

querySelector that can pierce Shadow DOM roots without knowing the path through nested shadow roots. Useful for automated testing of Web Components. Production use is not advised, this is for test environments/tools such as Web Driver, Playwright, Puppeteer

• webcomponents
• shadow-dom
• javascript
• puppeteer

A proper monster for front-end automated testing

• headless
• testing
• node
• javascript