Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.
- scraper
- twitter-api
- twitter-bot
Repository Index
78,850 visible repositories in the index
73–96 of 133 · Most stars
Learn step-by-step how to scrape Google Trends data and make a result comparison using Python and Oxylabs SERP API. Extract keywords, their popularity, breakdown by region, related queries, and more.
- google-trend
- google-trend-api
- google-trend-strategy
python parser for human readable dates
- hacktoberfest
admin ui for scrapy/open source scrapinghub
- scrapy
- dashboard
- scrapyd
- scrapy-ui
Generate and download e-books from online sources.
- lightnovel
- termux
- web-scraper
- console-app
日本电影元数据刮削器，配合kodi,emby,plex等本地媒体管理工具使用。可批量抓取，也可单个抓取。可抓取子目录下视频，多集视频（-cd1/-cd2）,带字幕作品（-c., -C.）。批量添加emby演员头像。
- jav
- jav-scraper
- emby
- kodi
REST implementation of Django authentication system.
A cloudflare verification bypass script for webscraping
- cloudflare-bypass
- bypass
- cloudflare
- cloudflare-bypass-script
Downloads and archives content from reddit
- imgur
- gfycat
- scraper
A CLI utility for taking screenshots of websites, recording video demos and scraping sites using JavaScript
- playwright
- playwright-python
- scraping
- screenshot-utility
A Python program to scrape secrets from GitHub through usage of a large repository of dorks.
invisible playwright: Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
- datadome
- perimeterx
- akamai
- antidetect-browser
Fully functional Pokerbot that works on PartyPoker, PokerStars and GGPoker, scraping tables with Open-CV (adaptable via gui) or neural network and making decisions based on a genetic algorithm and montecarlo simulation for poker equity calculation. Binaries can be downloaded with this link:
- poker
- pokerstars
- artificial-intelligence
Web Scraping Framework
- web-scraping
- http-client
- framework
- python
Scrape Twitter for Tweets
Free, open-source Google Maps scraper for lead generation (Python, no API key, no Docker). Exports name, phone, email, website, rating and Instagram/Facebook/LinkedIn/TikTok/YouTube/X links to CSV. 100 places with emails in 44 s; --grid beats Google's 120 cap. MX email check, ad-pixel detection. Skill for Claude Code, Codex and Cursor.
- b2b-leads
- claude-code
- google-maps
- google-maps-scraper
Download images from Google, Bing, Baidu. 谷歌、百度、必应图片下载.
- image-downloader
- google-images
- bing
- baidu
Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
- scraper
- sina
- corpus
Library to scrape and clean web pages to create massive datasets.
- artificial-intelligence
- natural-language-processing
- nlp
- text-mining
Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.
Python package for scraping recipes data
- data-extraction
- food
- html-parsing
- json-ld
Phone number OSINT toolkit with multi-API search (Google, GitHub, Numverify, Reddit, DuckDuckGo), Hudson Rock infostealer intelligence, and automatic report generation.
- osint
- python
- searchphone
- api-scraping
⛏⚽ Scrape soccer data from Club Elo, ESPN, FBref, Football-Data.co.uk, Sofascore, SoFIFA, Understat and WhoScored.
- soccer
- soccer-analytics
- sports-data
- soccer-data
Fast, robust Google Flights scraper (API) for Python. (Probably)
- airport
- flights
- google-flights
- google-flights-api