76,356 visible repositories in the index
1–22 of 22 · Most stars
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python ProxyPool for web spider
The premier source of truth powering network automation. Open source under Apache 2. Try NetBox Cloud free: https://netboxlabs.com/products/free-netbox-cloud/
Translated🤖 DIY-able multimodal AI chatbot | 🚀 Quickly connects to chat platforms such as WeChat, QQ, Telegram, and more | 🦈 Supports DeepSeek, Grok, Claude, Ollama, Gemini, OpenAI | Workflow system, web search, AI image generation, persona tuning, virtual maid, voice conversation |
Pythonic HTML Parsing for Humans™
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
TranslatedAsynchronous multi-platform chatbot framework written in Python
An Efficient ProxyPool with Getter, Tester and Server
Lightweight, scriptable browser as a service with an HTTP API
Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS :performing_arts:
Slack Developer Kit for Python
Web Scraping Framework
基于小红书 Web 端进行的请求封装。https://reajason.github.io/xhs/
基于 OneBot 标准的 Python 异步 QQ 机器人框架 / Asynchronous QQ robot framework based on OneBot for Python
A Telegram RSS bot that cares about your reading experience (calling for new maintainers: https://github.com/Rongronggg9/RSS-to-Telegram-Bot/issues/747)
Real time google image scraper. The process is automated by sending HTTP requests to retrieve image data which is then parsed and saved.
Web crawling framework based on asyncio.
Async Python 3.6+ web scraping micro-framework based on asyncio
A framework to build Slack apps using Python
A chat bot for Slack (https://slack.com).
AstrBot plugin and local HTTP service for Feiyu TTS, RVC v1 and optional score singing
Website to Scrapping all writeup from http://ctftime.org/ and you can organize which to read first!