Sign in

Repository Index

47,133 repositories indexed

Tag: Automation, bots, and scraping
Tag
Filters

Filters

Clear all filters

1–24 of 52 · Most stars

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

  • pocket
  • wget
  • browser-bookmarks
  • pinboard

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.

  • golang
  • chrome
  • chrome-debugging-protocol
  • testing

A Chrome DevTools Protocol driver for web automation and scraping.

  • cdp
  • chrome-headless
  • chrome-devtools
  • chrome-devtools-protocol

Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.

  • datadome
  • perimeterx
  • akamai
  • antidetect-browser

WKZombie is a Swift framework for iOS/OSX to navigate within websites and collect data without the need of User Interface or API, also known as Headless browser. It can be used to run automated tests / snapshots and manipulate websites using Javascript.