TranslatedA visual no-code/code-free web crawler/spider. 易采集 (EasySpider, "easy collection"): a visual browser automation testing/data collection/web crawler software that lets you design and execute crawler tasks graphically without code. Alias: ServiceWrapper, an intelligent service wrapping system for Web applications.
Repository Index
78,351 visible repositories in the index
1–24 of 34 · Most stars
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
- ai-agent
- anti-bot
- antidetect-browser
- automation
The open-source, privacy-friendly CAPTCHA you host yourself. Bots and AI agents out, people in.
- captcha
- javascript
- proof-of-work
- antispam
This GitHub repo is a powerhouse collection of APIs you can start using immediately to build everything from simple automations to full-scale applications. One of the most valuable API lists on GitHub—period. 💪
List of libraries, tools and APIs for web scraping and data processing.
- web-scraping
- captcha-bypass
- captcha-recaptcha
- crawling
Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.
- batch-processing
- claude
- content-extraction
- data-collection
A cross-platform Electron Desktop App to stream and download any Movie, TV Series or Anime in the World. Zero Ads and Tracking
- anime
- anime-downloader
- anime-scraper
- downloader
The next web scraper. See through the <html> noise.
Distributed crawler powered by Headless Chrome
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?
YouTube video downloader in javascript.
- youtube
- video-downloader
- scraper
- youtube-downloader
An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.
- ai-agent
- automation
- data-extraction
- event-driven-architecture
Professional-grade, local-first browser extension that transforms any webpage into high-fidelity, LLM-friendly Markdown entirely within the browser's runtime. Zero-cloud, privacy-centric, and designed specifically for AI workflows.
- ai-workflows
- browser-extension
- chrome-extension-
- clipboard-api
Web scraper for NodeJS
🔮 A Node.js scraper for humans.
- scraper
- node-scraper
- web-scraping
This GitHub repo is a powerhouse collection of scraping APIs for developers that you can start using immediately to build everything from simple automations to full-scale applications.
- api-library
- api-list
- scraping-api
- developer-api
A complete and versatile web scraper.
There was no free Dictionary API on the web when I wanted one for my friend, so I created one.
Node.js scraper to get data from Google Play
A curated collection of social media scraping APIs and tools for Instagram, LinkedIn, Twitter/X, TikTok, YouTube, Facebook, and more. Extract posts, profiles, videos, comments, and engagement metrics.
- facebook-api
- facebook-scraping
- linkedin-bot
- linkedin-scraping
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
Getting started with Puppeteer and Chrome Headless for Web Scraping
The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.
- automation
- chromium
- screenshot
- web-scraping
Download website to local directory (including all css, images, js, etc.)