Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
- datadome
- perimeterx
- akamai
- antidetect-browser
Repository Index
47,133 repositories indexed
25–44 of 44 · Most stars
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt, eBay Kleinanzeigen and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)
- fredy
- immowelt
- appartment
- appartments
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
Simple web scraping for R
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
A AI Browser run any site JavaScript from Python with the real Firefox engine. Headless SpiderMonkey + Necko for automation and scraping.
- anti-bot
- automation
- firefox
- headless-browser
TranslatedAI coding perks navigation: a roundup of relay stations and public-service stations for Claude Code, Codex, and Cursor, organizing free quotas, sign-up bonuses, check-in activities, and evaluation records, and providing a visual dashboard and a Python data collection tool.
- ai-coding
- api-relay
- claude-code
- codex
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.
- rvest
- rselenium
- httr
- scrape-websites
The unix-way web crawler
EveryInfra MCP server & agent plugin: scraper API for TikTok, Instagram, Amazon, YouTube, Xiaohongshu & Douyin. 573 data APIs across 106 platforms, from $0.56/1K calls. For Claude Code, Cursor, Codex.
- ai-agents
- claude-code
- cursor
- mcp
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
- ai-agents
- browser-automation
- data-extraction
- firecrawl
TranslatedAI subscription and card-shop price comparison platform: say what you need and let AI help you choose. Aggregates top-up service or account offers for ChatGPT / Codex, Claude, Gemini and more, and compares price trends, top-up channels and warranties. AI-powered shopping and price comparison for subscriptions and accounts, with cross-shop offers, price history and purchase details.
- ai
- price-comparison
- self-hosted
- web-scraping
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
- crawling
- csharp
- elixir
- ffi
The AI-native browser automation library. Snapshot + ref targeting — born from OpenClaw, built for agents, by agents.
Search the web and primary sources, read full pages, and check every citation. MCP server for Claude, Cursor, Codex and more. Runs on your machine.
Go-native browser automation via Chrome DevTools Protocol. No Node.js, no relay process, no external dependencies.
- browser-automation
- cdp
- chrome-devtools-protocol
- golang
A PHP project to check if websites are linking to your website
- php
- competitors
- seo
- seo-optimization
Go http.Client with a byte-exact browser TLS fingerprint (uTLS) — survive JA3/JA4 blocking without a headless browser.
- akamai-fingerprint
- anti-bot
- cloudflare-bypass
- go
Intelligent web page comparison tool with Wayback Machine support and visual regression testing
- visual-comparison
- wayback-machine
- web-scraping
- diff