A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
47,133 repositories indexed
25–48 of 298 · Most stars
A next-generation crawling and spidering framework.
TranslatedDouyin / TikTok platform tool for downloading works and collecting data
A customizable life embetterment robot.
A 100% free modern JS SaaS boilerplate (React, NodeJS, Prisma). Full-featured: Auth (email, google, github, slack, MS), Email sending, Background jobs, Landing page, Payments (Stripe, Polar.sh), Shadcn UI, S3 file upload. AI-ready with tailored AGENTS.md, skills, and Claude Code plugin. One cmd deploy. Powered by Wasp full-stack framework.
AWX provides a web-based user interface, REST API, and task engine built on top of Ansible. It is one of the upstream projects for Red Hat Ansible Automation Platform.
🚀 PR Agent: The Original Open-Source PR Reviewer. This project is not the Qodo free tier.
A little like that j-thing, only in Go.
TranslatedHigh-efficiency QQ bot support library
TranslatedWeChat little assistant
The open source Zapier alternative. Build workflow automation without spending time and money.
Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.
C# application with primary purpose of farming Steam cards from multiple accounts simultaneously.
Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots
TranslatedXiaohongshu (XiaoHongShu, RedNote) link extraction / post collection tool
Node.js Desktop Automation.
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
Connect APIs, remarkably fast. Free for developers.
Translated:orange_book: Chinese Xinhua Dictionary database. Includes xiehouyu (two-part allegorical sayings), idioms, words, and Chinese characters.
A scalable web crawler framework for Java.
A standalone version of the readability lib
🤖 Multi-platform IM AI Agent for Telegram, WhatsApp, Lark, and WeChat. Connects ChatGPT / Claude / Kimi / DeepSeek / Ollama / Pi for auto-replies, community analysis, contact management, and inactive-friend detection.
jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
TranslatedA new-generation web crawler platform that defines crawler workflows graphically, so you can build a crawler without writing code.