TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
56,638 visible repositories in the index
49–72 of 251 · Most stars
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
Translated:orange_book: Chinese Xinhua Dictionary database. Includes xiehouyu (two-part allegorical sayings), idioms, words, and Chinese characters.
🤖 Multi-platform IM AI Agent for Telegram, WhatsApp, Lark, and WeChat. Connects ChatGPT / Claude / Kimi / DeepSeek / Ollama / Pi for auto-replies, community analysis, contact management, and inactive-friend detection.
An Open-Source Asynchronous Coding Agent
Automated CAPTCHA solver for your browser. Works with Selenium, Puppeteer, Playwright, and more.
RobotGo, Go Native cross-platform RPA, GUI automation, Auto test and Computer use @vcaesar
Get the main content of any page as Markdown.
Capture website screenshots
💼【AI找工作助手】全平台自动投简历脚本:(boss、前程无忧、猎聘、智联招聘)
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
TranslatedIntelligent Xianyu (Goofish) customer service bot system: an AI-based attendance solution built specifically for the Xianyu platform, providing 24/7 automated attendance on Xianyu, with support for multi-expert collaborative decision-making, intelligent price negotiation, and context-aware conversation.
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
Visual Development for React, Vue, Svelte, Qwik, and more
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
Android Full-Stack Device Control Platform: WebRTC/H.264 remote desktop, UI/OCR/image-matching automation, one-click MITM, built-in Frida, proxy/VPN/frp/P2P networking, MCP/Agent, 160+ APIs, designed for multi-device clusters and engineered deployments.
TranslatedA self-media customer acquisition agent tailor-made for OPC/small, medium and micro enterprises
Python Script to download hundreds of images from 'Google Images'. It is a ready-to-run code!
A simple WhatsApp bot to manage groups
A graph node engine and editor written in Javascript similar to PD or UDK Blueprints, comes with its own editor in HTML5 Canvas2D. The engine can run client side or server side using Node. It allows to export graphs as JSONs to be included in applications independently.
✨ The all-contributors bot website and documentation. Recognize all contributors, not just the ones who push code ✨
🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
The first open-source agent skills builder. Define skills by vibe workflow, run on Claude Code, Cursor, Codex & more. Build Clawdbot 🦞· APIs for Lovable · Bots for Slack & Lark/Feishu · Skills are infrastructure, not prompts.