TranslatedA visual no-code/code-free web crawler/spider. 易采集 (EasySpider, "easy collection"): a visual browser automation testing/data collection/web crawler software that lets you design and execute crawler tasks graphically without code. Alias: ServiceWrapper, an intelligent service wrapping system for Web applications.
Repository Index
77,852 visible repositories in the index
1–24 of 24 · Most stars
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
- ai-agent
- anti-bot
- antidetect-browser
- automation
A graph node engine and editor written in Javascript similar to PD or UDK Blueprints, comes with its own editor in HTML5 Canvas2D. The engine can run client side or server side using Node. It allows to export graphs as JSONs to be included in applications independently.
- graph
- modular
- javascript
- visual-programming
The next web scraper. See through the <html> noise.
Distributed crawler powered by Headless Chrome
Converts .py to .exe using a simple graphical interface
- python
- py2exe
- pyinstaller
- automation
An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.
- ai-agent
- automation
- data-extraction
- event-driven-architecture
Web scraper for NodeJS
🔮 A Node.js scraper for humans.
- scraper
- node-scraper
- web-scraping
A complete and versatile web scraper.
There was no free Dictionary API on the web when I wanted one for my friend, so I created one.
Node.js scraper to get data from Google Play
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.
- automation
- chromium
- screenshot
- web-scraping
Download website to local directory (including all css, images, js, etc.)
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt, eBay Kleinanzeigen and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)
- fredy
- immowelt
- appartment
- appartments
Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of thousands.
Open-source design agent: on-brand stills, decks, diagrams, charts and motion graphics from a chat thread, built on Deep Agents.
- ai-agent
- deepagents
- hyperframes
- langgraph
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.
Self-hosted, invisible CAPTCHA that detects AI agents driving real browsers. GDPR, WCAG 2.2 AA, and EAA: no cookies, no third-party data sharing, and no visual or audio puzzle. With a false-positive budget enforced in CI. Proof of work, drop-in for Turnstile and reCAPTCHA.
- anti-bot
- behavioral-analysis
- bot-detection
- captcha
🔥 A daily streak system & portfolio for your projects.
- summer-of-making
- nextjs
- hackclub
- hacktoberfest
Create HTML snippets/embeds from URLs using info from oEmbed, Open Graph, meta tags.
Browser extension to simulate browsing behaviour in search engines.
- automation
- audit
- browser-extension
- firefox
Search npm packages by web scraping and without indexing all npm packages