Scrapy, a fast high-level web crawling & scraping framework for Python.
- python
- scraping
- crawling
- framework
132,241 visible repositories in the index
1–24 of 49 · Most stars
Scrapy, a fast high-level web crawling & scraping framework for Python.
Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring— MCP included! all for free or enjoy our SaaS plan!
Proxy server to bypass Cloudflare protection
AWX provides a web-based user interface, REST API, and task engine built on top of Ansible. It is one of the upstream projects for Red Hat Ansible Automation Platform.
MaiSaka, an LLM-based intelligent agent, is a digital lifeform devoted to understanding you and interacting in the style of a real human. She does not pursue perfection, nor does she seek efficiency; instead, she values warmth, authenticity, and genuine connection.
The Unofficial TikTok API Wrapper In Python
Open-Source Unified Vulnerability Management, DevSecOps & ASPM
Dark Web OSINT Tool
Scrape Facebook public pages without an API key
Errbot is a chatbot, a daemon that connects to your favorite chat service and bring your tools and some fun into the conversation.
:musical_note: The original MusicBot for Discord (formerly SexualRhinoceros/MusicBot)
Advanced Multi-Featured Telegram UserBot, Built in Python Using Telethon lib.
Pycord is a modern, easy to use, feature-rich, and async ready API wrapper for Discord written in Python
An extensible message tunneling chat bot framework. Delivers messages to and from multiple platforms and remotely control your accounts.
splinter - python test framework for web applications
Telegram Bot to store Posts and Documents and it can Access by Special Links.
Financial Data Extraction from Investing.com with Python
A robust, all-in-one GPT interface for Discord. ChatGPT-style conversations, image generation, AI-moderation, custom indexes/knowledgebase, youtube summarizer, and more!
A Python library to utilize AWS API Gateway's large IP pool as a proxy to generate pseudo-infinite IPs for web scraping and brute forcing.
Send WhatsApp message at certain time and many other things.
The ultimate tool to automate custom telegram message forwarding. Live-syncer, Auto-poster, backup-bot, cloner, chat-forwarder, duplicator, ... Call it whatever you like! tgcf can fulfill your custom needs.
🎭 Playwright integration for Scrapy
Example end to end data engineering project.
📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian government gazettes, accessible to everyone.