A collection of APIs for scraping video metadata, engagement stats, and public video data across multiple platforms.
Repository Index
142,273 visible repositories in the index
433–456 of 627 · Most stars
Scrape XBMC and Kodi movie metadeta and automatically rename files for Japanese Adult Videos (JAV), American Adult DVDs, and American Adult Webcontent
🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.
Stack blocks visually to build complex browser workflows and execute them via API
Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.
豆瓣电影/豆瓣读书 Scarpy 爬虫
- python
- scrapy
- douban
- douban-movie
A Python library for scraping the Google search engine.
- python-library
- python
- python3
🔖 Web & Electron based Anime Streaming App for 🐈s
Amazon Scraper. Scrape products from the amazon search result or reviews from the specific product
HTTP client made for scraping based on got.
😈📚 A curated library of research papers and presentations for counter-detection and web privacy enthusiasts.
- puppeteer
- puppeteer-extra
- papers
- counter-detection
A high-performance proxy rotation engine with automated IP management and real-time health monitoring
- http
- http-proxy
- ip-rotation
- proxy
豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章
:scissors: High performance, multi-threaded image scraper
A python binding for crfsuite
- data-science
- crf
- crfsuite
一款适用于央视网的网络视频流解析处理工具
- cctv
- downloader
- ffmpeg
- mulithreading
use multiple proxies with Scrapy
- scrapy
- proxy
The simple, fast, and modern web scraping library
Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.
m3u playlists for radio music, sorted by popularity
- radio
- music
- playlist
- sorted
crawl and scrape web pages in rust
A Multi-User Selfhosted price tracker for Amazon, Aliexpress, ebay and many more along with custom stores. Get notified when price matches one or more criterias set by the user
- automation
- ecommerce
- filamentphp
- laravel
Python package for scraping real estate property data
- finance
- properties
- real-estate
- realtor
The Slash OSINT Tool
- cyber-security
- doxing
- find-people
- hack