🕵️♂️ Collect a dossier on a person by username from 6K websites
- osint
- social-network
- identification
- socmint
Repository Index
67,762 visible repositories in the index
1–10 of 10 · Most stars
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
- python
- news
- crawler
- crawling
Incredibly fast crawler designed for OSINT.
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
One-stop Proxies Crawling and Aggregation Platform
- proxypool
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
A metasearch library that aggregates results from diverse web search services
- python
- search
- metasearch
- ddgs
ESB, SOA, REST, APIs and Cloud Integrations in Python
- python
- esb
- soa
- api-server
A Python feed reader library.
- rss
- rss-reader
- rss-aggregator
- rss-feed
Send Sir Perceval on a quest to retrieve and gather data from software repositories.
- grimoirelab
- perceval
- data-mining
- data-fetching