A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
Repository Index
47,133 repositories indexed
1–22 of 22 · Most stars
Elegant Scraper and Crawler Framework for Golang
Python ProxyPool for web spider
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
Incredibly fast crawler designed for OSINT.
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
可循环值守和多人录制的直播录制软件，支持抖音、TikTok、Youtube、快手、虎牙、斗鱼、B站、小红书、pandatv、sooplive、flextv、popkontv、twitcasting、winktv、百度、微博、酷狗、17Live、Twitch、Acfun、CHZZK、shopee等40+平台直播录制
AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
Dark Web OSINT Tool
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
Async Python 3.6+ web scraping micro-framework based on asyncio
The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.
Crawly, a high-level web crawling & scraping framework for Elixir.
A high performance web crawler / scraper in Elixir.
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.
Signal 18 repman - Replication Manager for MySQL / MariaDB / Percona Server
🕸️ Blazing fast GraphQL endpoints finder using subdomain enumeration, scripts analysis and bruteforce. 🕸️
FETCH THE PASSWORD STRETCHER
SpiderMan,a base-on Broadway fast high-level web crawling & scraping framework for Elixir.