Scrapy, a fast high-level web crawling & scraping framework for Python.
- python
- scraping
- crawling
- framework
Repository Index
47,133 repositories indexed
1–16 of 16 · Most stars
TranslatedProduction-grade platform for building agentic IM bots - Agent, knowledge base orchestration, plugin system / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信 (Qiye Weixin, "Enterprise WeChat"), 企微智能机器人 (Qiwei Zhineng Jiqiren, "Enterprise WeChat smart bot"), 公众号 (Gongzhonghao, "official account")) / 飞书 (Feishu, "flying book") / 钉钉 (Dingding, "nail nail") / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow
Proxy server to bypass Cloudflare protection
- puppeteer
- cloudflare
- proxy
- chrome
AWX provides a web-based user interface, REST API, and task engine built on top of Ansible. It is one of the upstream projects for Red Hat Ansible Automation Platform.
Python based web automation tool. Powerful and elegant.
- automation-framework
- python
- web-automation
Dark Web OSINT Tool
- tor
- tor-network
- deepweb
- dark-web
Translated[Captcha Recognition - Training] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.
- captcha-recognition
- tensorflow-tutorials
- ocr
- tensorflow
My tensorflow implementation of "A neural conversational model", a Deep learning based chatbot
Translateduse cnn recognize captcha by tensorflow. This project targets character-based image captchas, using tensorflow to implement a convolutional neural network for captcha recognition.
- python
- cnn
- tensorflow
Chatbot in 200 lines of code using TensorLayer
- tensorlayer
- tensorflow
- chatbot
- rnn
:scissors: High performance, multi-threaded image scraper
A repo to automatically generate and keep updated a series of Docker images through GitHub Actions.
Browser automation engine benchmark - Test bypass rates, performance & stealth against Cloudflare, DataDome, reCAPTCHA, Kasada, Imperva, Akamai, PerimeterX and other bot detection systems. Find the best browser for scraping.
- anti-detect
- antidetect-browser
- automation
- browser
Simple JMeter performance tests API for python
MERK is an open source, cross-platform, multiple-document interface GUI IRC client for Windows, Linux, and macOS written in Python, PyQt5, and Twisted.
- python3
- pyqt5
- gplv3
- irc-client
A repo-native coding-agent loop harness for Claude, Codex, Copilot, and other CLI agents. Agents can edit. Gates decide what lands. You set the plan in motion. The agents take a prompt, and each iteration must update specs and commit through guardrails.