Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.
- amazon-scraper
- amazon-scraping
- e-commerce-api
- web-scraping
Repository Index
78,850 visible repositories in the index
217–240 of 707 · Most stars
Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️
- scrapy
- python
- crawl
- crawler
Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. Docs 文档 :point_right:
- scrapy
- scrapyd
- scrapyd-ui
- scrapyd-api
Use Google News Scraper API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.
- google-news-scraper
- google-scraper
- google-scraper-api
- news-scraper
Open-source, self-hosted AI penetration testing framework: maps your attack surface into a graph, autonomously exploits it from a Kali sandbox with human approval gates, and opens PRs that fix what it finds. MCP both ways: plug in any MCP server as a tool, or drive RedAmon from Claude Code or your own agent.
- ai-pentesting
- autonomous-agents
- bug-bounty
- kali-linux
AI agents can now use real Android and iOS apps, just like a human.
- agents
- ai
- browser-use
- langgraph
Python Toolkit for Causal and Probabilistic Reasoning
- python
- bayesian-networks
- causal-inference
- causal-discovery
[CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.
- pruning
- model-compression
- efficient-deep-learning
- llm
Stealth browser automation for AI agents over MCP and the Chrome DevTools Protocol: navigation, network hooks, DOM extraction, and pixel-accurate UI cloning.
[SIGGRAPH'24] 2D Gaussian Splatting for Geometrically Accurate Radiance Fields
- novel-view-synthesis
- surface-reconstruction
- gaussian-splatting
Scrape Facebook public pages without an API key
- scraping
- facebook-scraping
- facebook-scraper
An environmental monitoring and regulation system
- raspberry-pi
- sensors
- regulation
- monitoring
pyTranscriber can be used to generate automatic transcription / automatic subtitles for audio/video files through a friendly graphical user interface.
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
A Python command-line and library that draws basic graphs in the terminal
PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.
A self-contained cryptographic library for Python
- cryptography
- security
- python
Do you want to LEARN NEW STUFF for FREE? Don't worry, with the power of web-scraping and automation, this script will find the necessary Udemy coupons & enroll you for PAID UDEMY COURSES, ABSOLUTELY FREE!
新浪微博爬虫（Scrapy、Redis）
Python 3 API wrapper for Garmin Connect to get statistics and set activities
- fitness
- garmin
- garmin-connect
- garmin-sdk
The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.
- amazon
- amazon-scraper
- python
- web-scraper
Pixel graphics in terminal with unicode braille characters
Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
Graphical client for the Soulseek peer-to-peer network