Chromium Binary for AWS Lambda and Google Cloud Functions
- aws-lambda
- puppeteer
- chromium
- serverless
132,241 visible repositories in the index
433–456 of 2,572 · Most stars
Chromium Binary for AWS Lambda and Google Cloud Functions
Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.
Download the entire Wayback Machine archive for a given URL.
使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
A serial device I/O tool
牛人快跑 - GeekGeekRun,求职找工作自动化工具,基于 Puppeteer、Electron。界面友好,简单易用!开源,免费!快速海投、自动开聊、已读不回提醒、职位信息抓取、不合适职位标记、僵尸职位清理;让你即刻变身成为一台冇得感情的求职机器🤖,找工作不内耗。宝宝不用动,妈妈全自动~祝你收获好Offer!
UI automation library for .Net
Translated[Captcha Recognition - Training] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.
Article publishing platform that automatically distributes your articles to various media channels
🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos/videos, contact information, followers, following and much more.
A tiny, fast Rust CLI that drives a real browser over the Chrome DevTools Protocol — built for coding agents.
Watch (parts of) webpages and get notified when something changes via e-mail, on your phone or via other means. Highly configurable.
Twitter Text Libraries. This code is used at Twitter to tokenize and parse text to meet the expectations for what can be used on the platform.
安卓平台自动化工具,无需 root。
Free Open Source Enterprise Grade RPA
Open Source AI trading agent that operates autonomously across 1000+ markets - Polymarket, Kalshi, Binance, Hyperliquid, Solana DEXs, 5 EVM chains. Scans for edge, executes instantly, manages risk while you sleep. Agent commerce protocol for machine-to-machine payments. Self-hosted. Built on Claude.
A service daemon to run Scrapy spiders
AI-powered Smart Robotic Process Automation 🤖
🍥 Bilibili 用户爬虫
A metasearch library that aggregates results from diverse web search services
A browser testing and web crawling library for PHP and Symfony
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.