Real time google image scraper. The process is automated by sending HTTP requests to retrieve image data which is then parsed and saved.
- google-image-scraper
- google-images-crawler
- image-scrape
- image-scraper
Repository Index
78,351 visible repositories in the index
97–120 of 132 · Most stars
Another API-less Instagram pictures and videos downloader. (defunct)
- instagram-scraper
- downloader
- python
Scrapes flight data from Google Flights and analyzes flight prices with Python and Oxylabs’ Google Flights API.
- google-flights-api
- google-flight-api
- google-flights-api-python
- google-flights-python
A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.
- google-scholar
- google-scholar-scraper
- python
- python-scraper
A code for extracting best-selling items, search results, and currently available deals from Amazon using Python and Oxylabs E-Commerce Scraper API.
- amazon
- amazon-scraper
- api
- python
Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion
python ip proxy tool scrapy crawl. 抓取大量免费代理 ip，提取有效 ip 使用
- proxy
- python
- ipproxy
A powerful no-code automation tool. Build workflows via drag-and-drop modules for web scraping, form filling and automated testing. | 一款功能强大的自动化工具，通过拖拽模块的方式快速构建自动化工作流，无需编写任何代码即可实现网页数据采集、表单填写、自动化测试等任务。【QQ交流群：115069513】
- ddddocr
- easyocr
- express-js
- face-recognition
Implementation of X/Twitter v1, v2, and GraphQL APIs
- api
- automation
- client
- scrape
OnionSearch is a script that scrapes urls on different .onion search engines.
- information-gathering
- osint
- osint-tools
- open-source-intelligence
Open Source Intelligence Interface for Deep Web Scraping
- ahmia
- deep-web-search
- osint
- tor
Finviz analysis python library.
- web-scraping
- fundamental-analysis
- stock-news
- technical-analysis
Free email OSINT tool, 5000+ platforms, identity clustering, breach detection. No API keys required. pip install mailaccess
Learn how to build your own Google Jobs scraper that simultaneously scrapes Google Jobs for multiple search queries and geo-locations with Python and Oxylabs’ Google Jobs Scraper API. https://oxylabs.io/blog/how-to-scrape-google-jobs
- google-scraping
- python
- scraper
- scraper-api
The process of handling CAPTCHA when extracting public data from Amazon with Oxylabs Amazon Scraper API.
- amazon
- amazon-scraper
- amazon-scraper-api
- captcha
🏀 Python3 网络爬虫实战（部分含详细教程）猫眼 腾讯视频 豆瓣 研招网 微博 笔趣阁小说 百度热点 B站 CSDN 网易云阅读 阿里文学 百度股票 今日头条 微信公众号 网易云音乐 拉勾 有道 unsplash 实习僧 汽车之家 英雄联盟盒子 大众点评 链家 LPL赛程 台风 梦幻西游、阴阳师藏宝阁 天气 牛客网 百度文库 睡前故事 知乎 Wish
- python3
- requests
- scrapy
- spider
Boss直聘爬虫 / BOSS直聘职位数据抓取工具，基于 Chrome CDP 协议复用真实登录态，绕过字体反爬，输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.
- boss-zhipin
- chrome-cdp
- spider
- boss-zhipin-scraper
Google Play Scraper for collecting public details about applications, games, movies & TV shows, books, and more.
- google-play
- google-play-api
- google-play-scraper
XSS spider - 66/66 wavsep XSS detected
Async Python 3.6+ web scraping micro-framework based on asyncio
- asyncio
- aiohttp
- asyncio-spider
- crawler
Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
A chat bot for Slack (https://slack.com).
Tools for various online judges. Downloading sample cases, generating additional test cases, testing your code, and submitting it.
- competitive-programming
- automation
- scraping
- atcoder
Generate smart and powerful wordlists
- wordlist
- password
- hacking-tool
- password-cracking