🕵️♂️ Collect a dossier on a person by username from 6K websites
- osint
- social-network
- identification
- socmint
Repository Index
79,841 visible repositories in the index
1–24 of 29 · Most stars
Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring— MCP included! all for free or enjoy our SaaS plan!
- website-monitor
- website-monitoring
- change-detection
- monitoring
This is a python API which allows you to get the transcript/subtitles for a given YouTube video. It also works for automatically generated subtitles and it does not require an API key nor a headless browser, like other selenium based solutions do!
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
job-ops: DevOps principles applied to job hunting. A self-hosted pipeline to track, analyze, and assist your application process
- automation
- self-hosted
- job-search
- jobhunt
🔮 A Node.js scraper for humans.
- scraper
- node-scraper
- web-scraping
Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes
- crawler
- proxypool
Use Google News Scraper API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.
- google-news-scraper
- google-scraper
- google-scraper-api
- news-scraper
Automatically crawl arXiv papers daily and summarize them using AI. Illustrating them using GitHub Pages.
Programmatically collect normalized news from (almost) any website.
🕷️Github China/Global User Ranking, Global Warehouse Star Ranking (Github Action is automatically updated daily).
Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.
Automatically extract body content (and other cool stuff) from an html document
A research tool for visually exploring Bureau of Labor Statistics Occupational Outlook Handbook data. This is not a report, a paper, or a serious economic publication — it is a development tool for exploring BLS data visually.
Retrieve author and publication information from Google Scholar in a friendly, Pythonic way without having to worry about CAPTCHAs!
- scholar
- googlescholar
- scholarly-articles
- scholarly-communications
Financial Data Extraction from Investing.com with Python
- investing-api
- historical-data
- investing
- investing-python
A Python based web application scanner to gather OSINT and fuzz for OWASP vulnerabilities on a target website.
- web
- application
- scanner
- osint
Free email OSINT tool, 5000+ platforms, identity clustering, breach detection. No API keys required. pip install mailaccess
Finviz analysis python library.
- web-scraping
- fundamental-analysis
- stock-news
- technical-analysis
Google Play Scraper for collecting public details about applications, games, movies & TV shows, books, and more.
- google-play
- google-play-api
- google-play-scraper
Pull current and historical baseball statistics using Python (Statcast, Baseball Reference, FanGraphs)
- baseball
- sabermetrics
- python
- data
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.
The unix-way web crawler