The Big Brother is a weaponized OSINT platform featuring username enumeration (473+ platforms), quad-vector visual intelligence, Sky Radar tracking, crypto wallet analysis, SSL intelligence, digital footprint reconstruction, EXIF extraction, advanced dorking, and network reconnaissance.
js cookie逆向利器:js cookie变动监控可视化工具 & js cookie hook打条件断点
:paw_prints: Creeper - The Next Generation Crawler Framework (Go)
😈📚 A curated library of research papers and presentations for counter-detection and web privacy enthusiasts.
- puppeteer
- puppeteer-extra
- papers
- counter-detection
《爬虫逆向进阶实战》书籍代码库
- crawler
- spiders
- android-resever
- python
Google Search Results via SERP API pip Python Package
- python
- serp-api
- bing-image
- google-crawler
Guide to Using Google Sheets for Basic Web Scraping
- web-scraping
- google-sheets-web-scraping
- web-scraping-google-sheets
- google-trends-api
将JMComic-Crawler下载的图片合并到pdf中
A lightweight web crawler framework.(Java爬虫框架)
:newspaper: Let LLM Summarize Hacker News for You
- hacker-news
- python
- data-extraction
- hacker-news-reader
A Tumblr and Twitter Blog Backup Application
The best PTT library
Two dumb distributed crawlers
Wscan is a web security scanner that focuses on web security, dedicated to making web security accessible to everyone.
- crawler
- passive-vulnerability-scanner
- poc
- sql-injection
A Facebook crawler
Python script, which empowers people with no programming background to generate robust leads on a mass scale. This repo will be compiled of various versatile techniques used in lead generation.
- lead-generation
- python
- scraper
- chromedriver
狠心开源企业级舆情新闻爬虫项目:支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除;爬虫一键部署;爬虫监控可视化; 配置集群爬虫分配策略;👉 现成的docker一键部署文档已为大家踩坑 an enterprise-grade public opinion news crawler project: supports one-click operation of any number of crawlers, scheduled crawler tasks, batch deletion of crawlers; one-click deployment of crawlers
- apscheduler
- python
- scrapy
- scrapy-crawler
OSINT Swiss Army Knife
- go
- golang
- osint
- haveibeenpwnd
A search application to explore, discover and share online files
Moodle-DL downloads course content fast from Moodle (eg. lecture pdfs)
- moodle
- moode-crawler
- crawler
- moodle-downloader
CatGate is a small crawler framework based on Chrome extension . CatGate是一个基于浏览器插件的数据抓取工具。做成浏览器插件无需模拟登入,能最真实的模仿用户行为和特征。
➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are completely removed. Crawl and convert any website into LLM-ready markdown.
API of DouYin for Humans used to Crawl Popular Videos and Musics
The Native Terminal Emulator with a builtin AI Harness