TranslatedA visual no-code/code-free web crawler/spider. 易采集 (EasySpider, "easy collection"): a visual browser automation testing/data collection/web crawler software that lets you design and execute crawler tasks graphically without code. Alias: ServiceWrapper, an intelligent service wrapping system for Web applications.
Repository Index
83,087 visible repositories in the index
1–24 of 35 · Most stars
TranslatedXiaohongshu (XiaoHongShu, RedNote) link extraction / post collection tool
Connect APIs, remarkably fast. Free for developers.
- eventsourcing
- event-sourcing
- automation
- workflow
A standalone version of the readability lib
💯 Teach puppeteer new tricks through plugins.
- puppeteer
- chrome
- automation
- headless-chrome
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
Reverse engineering WhatsApp Web.
- node
- whatsapp-web
- encryption
📜 Extract meaningful content from the chaos of a web page
TranslatedBased on Dineshkarthik's project. Cross-platform, supports viewing download progress on the web, supports issuing download commands via bot, supports downloading from private groups that have already been joined even when downloading of their resources is restricted. telegram media download,Download media files from a telegram conversation/chat/channel up to 2GiB per file
- media-downloader
- flask
- cross-platform
- downloader
TranslatedZotero translators for Chinese web page scraping 🎉 This is Zotero translators for Chinese Sites(beta), not the official Zotero repo
- zotero
- translators
- javascript
- cnki
An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.
- ai-agent
- automation
- data-extraction
- event-driven-architecture
A complete and versatile web scraper.
A node.js library for testing modern web applications
- testing-tools
- headless
- headless-browsers
- headless-chrome
Automatically crawl arXiv papers daily and summarize them using AI. Illustrating them using GitHub Pages.
Shuffle: A general purpose security automation platform. Our focus is on collaboration and resource sharing.
- automation
- cybersecurity
- openapi
- shuffle
给女朋友做的微信小程序！情侣自己的任务和商城系统！
- wechat-mini-program
- miniprogram
- weixin
A very simple Ticket System based on WhatsApp messages, that allow multi-users in same WhatsApp account.
免费的公众号 RSS，支持扩展任意 APP
共享黑名单, 一键拉黑所有黄推诈骗犯. Block scammers who sending fake porn comments, and help you improve your experience using Twitter.
- porn-filter
- spam-filtering
永久免费 微信ipad、微信mac协议，可实现微信80%功能；支持62数据登录、扫码登录、收发朋友圈、查看朋友圈、微信建群、微信拉人进群、微信公众号阅读、微信消息收发、微信附近的人定位、微信添加好友、微信红包接收、微信防撤回、分享小程序、微信加粉、微信收藏、微信标签等
python爬虫项目合集，从基础到js逆向，包含基础篇、自动化篇、进阶篇以及验证码篇。案例涵盖各大网站(xhs douyin weibo ins boss job，jd...)，你将会学到有关爬虫以及反爬虫、自动化和验证码的各方面知识
- playwright
- python
- python-crawler
- reverse-engineering
Zotero Translators
The URL engine behind Iframely. Self-hosted parsers that turn links into metadata, previews and embeds.
- embeds
- oembed
- twitter-cards
- open-graph
A dialogue engine for creating chat bots