Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of thousands.
Repository Index
142,187 visible repositories in the index
49–69 of 69 · Most stars
Declarative DOM extraction expression evaluator. 👨⚕️
Scrape websites for text by CSS selector.
译文:Puppeteer 与 Chrome Headless —— 从入门到爬虫
- puppeteer
- headless-chrome
- scraping-websites
Popcorn Time is a multi-platform, free software BitTorrent client that includes an integrated media player. Compatible API Anime/Movies/Show Scrapper
- popcorn-api
- trakt
- metadata
- popcorn
Real-time detection of anti-bot systems, captchas & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.
Nextjs server to query websites with GraphQL
LinkedIn Scraper (currently working 2020)
TranslatedLet any AI agent control your own Chrome, with all your logged-in sessions. MCP + Chrome extension, works with Claude Code / Codex / Cursor / Gemini CLI.
- ai-agents
- browser-automation
- chrome-extension
- claude-code
⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥
Free Web Scraping Tool with Java
a reliable high-level web crawling & scraping framework for Node.js.
- scraping-framework
- crawler
- crawling
- headless-chrome
Web Scraping with GPT-4 Vision API and Puppeteer
Client-side media downloader App and CLI built with Capacitor and Node.js.
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.
Self-hosted, invisible CAPTCHA that detects AI agents driving real browsers. GDPR, WCAG 2.2 AA, and EAA: no cookies, no third-party data sharing, and no visual or audio puzzle. With a false-positive budget enforced in CI. Proof of work, drop-in for Turnstile and reCAPTCHA.
- anti-bot
- behavioral-analysis
- bot-detection
- captcha
🔥 A daily streak system & portfolio for your projects.
- summer-of-making
- nextjs
- hackclub
- hacktoberfest
TickTock Automation: Community-Driven Bot for Discord & Telegram Content Publishing
- automations
- browser-automation
- dm
- github-actions
:eyeglasses: Stream for rendering audio data
Browser extension to simulate browsing behaviour in search engines.
- automation
- audit
- browser-extension
- firefox
Search npm packages by web scraping and without indexing all npm packages