Scrapy, a fast high-level web crawling & scraping framework for Python.
- python
- scraping
- crawling
- framework
47,133 repositories indexed
1–12 of 12 · Most stars
Scrapy, a fast high-level web crawling & scraping framework for Python.
Proxy server to bypass Cloudflare protection
AWX provides a web-based user interface, REST API, and task engine built on top of Ansible. It is one of the upstream projects for Red Hat Ansible Automation Platform.
Dark Web OSINT Tool
Distributed task queue with full async support
CLI task management & automation tool
"Security Incidents In A Box!" A modular, menu-driven, cross-platform tool for building customized, time-delayed, distributed security events. Easily create custom event chains for Blue- & Red Team drills and sensor / alert mapping. Red Teams can create decoy incidents, distractions, and lures to support and scale their operations. Build event sequences ("narratives") to simulate realistic scenarios and generate corresponding network and filesystem artifacts.
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
Automation of some MAPT activities and interaction with the mobile Android device.
Build beautiful Slack UIs fast
AWSDoor is a red team automation tool designed to simulate advanced attacker behavior in AWS environments
A repo-native coding-agent loop harness for Claude, Codex, Copilot, and other CLI agents. Agents can edit. Gates decide what lands. You set the plan in motion. The agents take a prompt, and each iteration must update specs and commit through guardrails.