🕵️♂️ Collect a dossier on a person by username from 6K websites
- osint
- social-network
- identification
- socmint
142,273 visible repositories in the index
1–24 of 68 · Most stars
🕵️♂️ Collect a dossier on a person by username from 6K websites
TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
Incredibly fast crawler designed for OSINT.
TranslatedXiaohongshu (XiaoHongShu, RedNote) link extraction / post collection tool
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
Python Script to download hundreds of images from 'Google Images'. It is a ready-to-run code!
One-stop Proxies Crawling and Aggregation Platform
Official Bright Data CLI - scrape, search, and extract structured web data directly from your terminal.
Extract any website's complete design system with one command. DTCG tokens, semantic+primitive+composite, MCP server for Claude Code/Cursor/Windsurf, multi-platform emitters (iOS SwiftUI, Android Compose, Flutter, WordPress), Tailwind v4, Figma variables, shadcn/ui, CSS health audit, WCAG remediation, Chrome extension. MIT, Playwright, Node 20+.
Successor of Undetected-Chromedriver. Providing a blazing fast framework for web automation, webscraping, bots and any other creative ideas which are normally hindered by annoying anti bot systems like Captcha / CloudFlare / Imperva / hCaptcha
Swiss-army tool for scraping and extracting data from online assets, made for hackers
An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
Use Google News Scraper API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.
Get account information, photos, videos, stories and comments.
🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos/videos, contact information, followers, following and much more.
AutoCLI is a Blazing fast, memory-safe command-line tool — Fetch information from any website with a single command. Covers Twitter/X, Reddit, YouTube, HackerNews, Bilibili, Zhihu, Xiaohongshu, and 55+ sites, with support for controlling Electron desktop apps, integrating local CLI tools (gh, docker, kubectl), now powered by AutoCLI.ai .
Programmatically collect normalized news from (almost) any website.
Export tweets, bookmarks, lists and much more from Twitter(X) web app. (推文/书签/收藏/列表导出工具)
admin ui for scrapy/open source scrapinghub
Generate and download e-books from online sources.
Point it at any web page and it finds the video, transcodes it, and streams it to your TV in real time. It even burns in subtitles.
多播放源自动采集在线影视网站 golang vue