Amazon Scraper. Scrape products from the amazon search result or reviews from the specific product
Repository Index
142,273 visible repositories in the index
313–336 of 452 · Most stars
HTTP client made for scraping based on got.
😈📚 A curated library of research papers and presentations for counter-detection and web privacy enthusiasts.
- puppeteer
- puppeteer-extra
- papers
- counter-detection
A high-performance proxy rotation engine with automated IP management and real-time health monitoring
- http
- http-proxy
- ip-rotation
- proxy
豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章
:scissors: High performance, multi-threaded image scraper
一款适用于央视网的网络视频流解析处理工具
- cctv
- downloader
- ffmpeg
- mulithreading
use multiple proxies with Scrapy
- scrapy
- proxy
The simple, fast, and modern web scraping library
Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.
m3u playlists for radio music, sorted by popularity
- radio
- music
- playlist
- sorted
A Multi-User Selfhosted price tracker for Amazon, Aliexpress, ebay and many more along with custom stores. Get notified when price matches one or more criterias set by the user
- automation
- ecommerce
- filamentphp
- laravel
Python package for scraping real estate property data
- finance
- properties
- real-estate
- realtor
The Slash OSINT Tool
- cyber-security
- doxing
- find-people
- hack
Google Search Results via SERP API pip Python Package
- python
- serp-api
- bing-image
- google-crawler
Guide to Using Google Sheets for Basic Web Scraping
- web-scraping
- google-sheets-web-scraping
- web-scraping-google-sheets
- google-trends-api
Fast, stateless CLI for web search and scrape. Built for AI agents.
operative framework is a rust investigation OSINT framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.
- fingerprint
- framework
- gathering
Node.js scraper service for Open Graph Info and More!
This library was created for testing and training purposes to retrieve the page source of websites, create Cloudflare Turnstile tokens and create Cloudflare WAF sessions.
- bypass
- cf-clearance
- cloudflare
- cloudflare-scrape
A node server and module which allows for cross-domain page scraping on web documents with JSONP or POST.
List of regex for scraping secret API keys and juicy information.
- bugbounty
- google-api
- juicy
A list of scrapers from around the web.
- scraper
- web-scraper
- list
- scrape-websites
🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
- ai
- automation
- data-extraction
- docker