Scrapy+Splash for JavaScript integration
- scrapy
- headless-browsers
142,273 visible repositories in the index
265–288 of 1,451 · Most stars
Scrapy+Splash for JavaScript integration
Translated[Captcha Recognition - Training] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.
🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos/videos, contact information, followers, following and much more.
Open Source AI trading agent that operates autonomously across 1000+ markets - Polymarket, Kalshi, Binance, Hyperliquid, Solana DEXs, 5 EVM chains. Scans for edge, executes instantly, manages risk while you sleep. Agent commerce protocol for machine-to-machine payments. Self-hosted. Built on Claude.
A service daemon to run Scrapy spiders
A metasearch library that aggregates results from diverse web search services
A browser testing and web crawling library for PHP and Symfony
Automatically crawl arXiv papers daily and summarize them using AI. Illustrating them using GitHub Pages.
Make your job hunt easy by automating your application process with this Auto Applier
AutoCLI is a Blazing fast, memory-safe command-line tool — Fetch information from any website with a single command. Covers Twitter/X, Reddit, YouTube, HackerNews, Bilibili, Zhihu, Xiaohongshu, and 55+ sites, with support for controlling Electron desktop apps, integrating local CLI tools (gh, docker, kubectl), now powered by AutoCLI.ai .
Perplexity Scraper Track brand mentions, analyze rankings, and gain competitor intelligence from Perplexity. Get started in minutes.
Node.js scraper to get data from Google Play
Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.
🤖 Crear Chatbot WhatsApp en minutos. Únete a este proyecto OpenSource
微信小程序多端实时运行工具
Pycord is a modern, easy to use, feature-rich, and async ready API wrapper for Discord written in Python
A high-level API to control headless Chrome or Chromium over the DevTools Protocol. It is the Rust equivalent of Puppeteer, a Node library maintained by the Chrome DevTools team.
A framework to build Slack apps using JavaScript
WhatsApp CLI: sync, search, send
使用机器学习算法完成对12306验证码的自动识别
A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
Translateduse cnn recognize captcha by tensorflow. This project targets character-based image captchas, using tensorflow to implement a convolutional neural network for captcha recognition.
Foundational low latency web data collecting in Rust
DecryptLogin: APIs for loginning some websites by using requests.