Repository Index

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

• agent-infrastructure
• ai-agent
• ai-search
• automation

JavaScript API for Chrome and Firefox

• headless-chrome
• testing
• web
• developer-tools

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.

• anti-detect
• bot-detection
• browser-automation
• chromium

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

• pocket
• wget
• browser-bookmarks
• pinboard

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

• web-scraping
• web-crawling
• npm
• headless-chrome

The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.

• agents
• ai
• playwright
• ai-agents

Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust

• browser
• rust
• servo
• browser-automation

✨ AI Spreadsheet for Business

• airtable
• airtable-alternative
• database
• no-code

A next-generation crawling and spidering framework.

• crawler
• web-spider
• gocrawler
• spider-framework

A 100% free modern JS SaaS boilerplate (React, NodeJS, Prisma). Full-featured: Auth (email, google, github, slack, MS), Email sending, Background jobs, Landing page, Payments (Stripe, Polar.sh), Shadcn UI, S3 file upload. AI-ready with tailored AGENTS.md, skills, and Claude Code plugin. One cmd deploy. Powered by Wasp full-stack framework.

• full-stack
• open-source
• saas
• nodejs

Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.

• docker
• chrome
• puppeteer
• browserless

A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.

• golang
• chrome
• chrome-debugging-protocol
• testing

TranslatedWeekly Go Online Meetup via Bilibili｜Go Night Reading｜Share Go-related technical topics through live streaming on Bilibili, and every day everyone communicates and discusses programming topics in a timely way on WeChat/Telegram/Slack.

• golang
• gopher
• shenzhen
• offline

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

• llm
• proxy

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

• ai-agent
• anti-bot
• antidetect-browser
• automation

A standalone version of the readability lib

A Chrome DevTools Protocol driver for web automation and scraping.

• cdp
• chrome-headless
• chrome-devtools
• chrome-devtools-protocol

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

• web-scraping
• text-extraction
• nlp
• html2text

Low-code backend platform. Manage database on spreadsheet-like UI and build cloud functions workflows in JS/TS, all in your browser.

• firebase
• firestore
• backend
• cloud-functions

SuiteCRM - Open source CRM for the world

• crm
• php
• agplv3
• accounts

Chrome Debugging Protocol interface for Node.js

• chrome-debugging-protocol
• browser
• javascript
• nodejs

🔍 gowitness - a golang, web screenshot utility using Chrome Headless

• chrome
• headless
• screenshot
• security

Headless chrome/chromium automation library (unofficial port of puppeteer)

• automation
• puppeteer
• chromium

Headless Chrome .NET API

• puppeteer
• chrome
• chromium
• automation