SpiderFoot automates OSINT for threat intelligence and mapping your attack surface.
- footprinting
- osint
- threatintel
- python
Repository Index
47,133 repositories indexed
1–17 of 17 · Most stars
Python ProxyPool for web spider
TranslatedA Python web scraping tutorial series, learning Python web scraping from 0 to 1, including browser packet capture and mobile APP packet capture with tools such as fiddler and mitmproxy, the use of the various modules involved in web scraping, such as requests, beautifulSoup, selenium, appium, scrapy, etc., as well as IP proxies, CAPTCHA recognition, using Mysql and MongoDB databases with Python, multi-threaded and multi-process scraping, reverse engineering and cracking of CSS scraping encryption, JS scraping reverse engineering, distributed scraping, practical scraping project examples, etc.
- python3
- python-script
- python-spider
Translated:rainbow:Python3 web crawler practice: Taobao, JD.com, NetEase Cloud Music, Bilibili, 12306, Douyin, Biquge, comic and novel downloads, music and movie downloads, etc.
- python-spider
- python3
- python
- webspider
Translated😮Python simulated login for some large websites, plus some simple web crawlers. I hope they are helpful to you❤️. If you like it, remember to give it a star🌟
- python
- spiders
- selenium
- twitter-bot
Incredibly fast crawler designed for OSINT.
TranslatedPython open-source project "The Road to Self-Taught Programming", with step-by-step tutorials for beginners: AI Lab, treasure videos, data structures, study guides, hands-on machine learning, hands-on deep learning, web crawlers, big-company interview experiences, programmer life, resource sharing.
TranslatedLive stream recording software that supports looped monitoring and recording multiple streamers at once. It supports recording live streams from 40+ platforms, including Douyin, TikTok, Youtube, Kuaishou, Huya, Douyu, Bilibili, Xiaohongshu, pandatv, sooplive, flextv, popkontv, twitcasting, winktv, Baidu, Weibo, Kugou, 17Live, Twitch, Acfun, CHZZK, shopee, and more
- douyin-live
- douyin-api
- douyulive
- live-recorder
Dark Web OSINT Tool
- tor
- tor-network
- deepweb
- dark-web
:spider_web: input/output for many mesh formats
- vtk
- pypi
- python
- mesh
Async Python 3.6+ web scraping micro-framework based on asyncio
- asyncio
- aiohttp
- asyncio-spider
- crawler
The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.
- csrf
- crawler
- csrf-attacks
- token-generation
:spider_web: Gmsh for Python
- python
- pypi
- mesh-generation
- engineering
Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.
- anti-crawling
- cloud-native
- crawler
- deception
🕸️ Blazing fast GraphQL endpoints finder using subdomain enumeration, scripts analysis and bruteforce. 🕸️
FETCH THE PASSWORD STRETCHER
- password
- stretcher
- mutations
- cracking
Fetch and normalize parameterized URLs from the Wayback CDX API (OSINT, inspired by ParamSpider).
- bugbounty
- cdx
- cli
- kali-linux