HTML parsing and querying with CSS selectors
- hacktoberfest
- rust
Repository Index
78,850 visible repositories in the index
193–216 of 328 · Most stars
Free, open-source Google Maps scraper for lead generation (Python, no API key, no Docker). Exports name, phone, email, website, rating and Instagram/Facebook/LinkedIn/TikTok/YouTube/X links to CSV. 100 places with emails in 44 s; --grid beats Google's 120 cap. MX email check, ad-pixel detection. Skill for Claude Code, Codex and Cursor.
- b2b-leads
- claude-code
- google-maps
- google-maps-scraper
CRAP - 开源API接口管理平台 | 完全开源、免费使用的API接口管理系统、BUG管理系统：API接口管理、文档管理、数据库表管理、接口调试、浏览器调试插件、导出word&pdf接口…..，采用SpringMVC + MyBatis + Lucene + Bootstrap + Angularjs + Iconfont + Guava Cache ，线上使用地址：http://api.crap.cn
Download images from Google, Bing, Baidu. 谷歌、百度、必应图片下载.
- image-downloader
- google-images
- bing
- baidu
The undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for speed, privacy, and scalability.
- automation
- browser-automation
- browserless
- chromedriver
Getting started with Puppeteer and Chrome Headless for Web Scraping
This repository helps you learn Python and Machine Learning from scratch.
- python
- jupyter-notebook
- pandas-dataframe
- numpy
OSINT cheat sheet, list OSINT tools, wiki, dataset, article, book , red team OSINT for hackers and OSINT tips and OSINT branch. This repository will grow every time will research, there is a research, science and technology, tutorial. Please use it wisely.
Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
- scraper
- sina
- corpus
TikTok LIVE API for Node.js: An unofficial library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.
- tiktok
- tiktok-api
- tiktok-live
- chat
Library to scrape and clean web pages to create massive datasets.
- artificial-intelligence
- natural-language-processing
- nlp
- text-mining
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
- golang
- go
- cloning
- crawler
Web Scraper in Go, similar to BeautifulSoup
- golang
- go
- webscraper
- webscraping
Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.
Python package for scraping recipes data
- data-extraction
- food
- html-parsing
- json-ld
Transform Web Content into LLM-Ready Data
- crawl4ai
- crawler
- crawling-python
- html2markdown
Open source alternative frontend for TikTok made using PHP
- tiktok
- alternative-frontends
- php
- proxitok
Phone number OSINT toolkit with multi-API search (Google, GitHub, Numverify, Reddit, DuckDuckGo), Hudson Rock infostealer intelligence, and automatic report generation.
- osint
- python
- searchphone
- api-scraping
Get info from any web service or page
- opengraph
- twitter-cards
- embeds
- scraping
⛏⚽ Scrape soccer data from Club Elo, ESPN, FBref, Football-Data.co.uk, Sofascore, SoFIFA, Understat and WhoScored.
- soccer
- soccer-analytics
- sports-data
- soccer-data
Fast, robust Google Flights scraper (API) for Python. (Probably)
- airport
- flights
- google-flights
- google-flights-api
Real time google image scraper. The process is automated by sending HTTP requests to retrieve image data which is then parsed and saved.
- google-image-scraper
- google-images-crawler
- image-scrape
- image-scraper
Another API-less Instagram pictures and videos downloader. (defunct)
- instagram-scraper
- downloader
- python
Scrapes flight data from Google Flights and analyzes flight prices with Python and Oxylabs’ Google Flights API.
- google-flights-api
- google-flight-api
- google-flights-api-python
- google-flights-python