Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Repository Index
71,235 visible repositories in the index
313–336 of 564 · Most stars
HTML parsing and querying with CSS selectors
- hacktoberfest
- rust
Free, open-source Google Maps scraper for lead generation (Python, no API key, no Docker). Exports name, phone, email, website, rating and Instagram/Facebook/LinkedIn/TikTok/YouTube/X links to CSV. 100 places with emails in 44 s; --grid beats Google's 120 cap. MX email check, ad-pixel detection. Skill for Claude Code, Codex and Cursor.
- b2b-leads
- claude-code
- google-maps
- google-maps-scraper
The fastest way to understand code
- agent-skills
- architecture-as-code
- architecture-diagrams
- claude-skills
Translated🌌 Your Self-hosted Comment System.
- comment-system
- blog
- self-hosted
- golang
Download images from Google, Bing, Baidu. 谷歌、百度、必应图片下载.
- image-downloader
- google-images
- bing
- baidu
The undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for speed, privacy, and scalability.
- automation
- browser-automation
- browserless
- chromedriver
Feature-rich WhatsApp bot supporting multiple sessions
Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
- scraper
- sina
- corpus
ChatGPT Plus/Team/Pro 订阅协议端到端重放工具集 · hCaptcha 视觉求解器 · 反欺诈机制实证研究 / End-to-end protocol replay toolkit for ChatGPT Plus/Team/Pro subscription with from-scratch hCaptcha solver and empirical anti-fraud research
- adversarial-ml
- anti-fraud
- bug-bounty
- captcha-solver
TikTok LIVE API for Node.js: An unofficial library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.
- tiktok
- tiktok-api
- tiktok-live
- chat
Library to scrape and clean web pages to create massive datasets.
- artificial-intelligence
- natural-language-processing
- nlp
- text-mining
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
- c-sharp
- abot
- abot-nuget
- crawler
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
- golang
- go
- cloning
- crawler
Web Scraper in Go, similar to BeautifulSoup
- golang
- go
- webscraper
- webscraping
🚀2020淘宝+京东+支付宝双十一|双11全民养猫|全民营业自动化脚本【全额奖励，防检测】
The repository host gives no description.
给女朋友做的微信小程序！情侣自己的任务和商城系统！
- wechat-mini-program
- miniprogram
- weixin
VoceChat Web App
Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.
Python package for scraping recipes data
- data-extraction
- food
- html-parsing
- json-ld
Live Helper Chat - live support for your website. Featuring web and mobile apps, Voice & Video & ScreenShare. Supports Telegram, Twilio (whatsapp), Facebook messenger including building a bot.
- live-support
- chat-application
- chat
- livehelp
An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.
- telegram
- archive
- wayback-machine
- save-the-internet
Transform Web Content into LLM-Ready Data
- crawl4ai
- crawler
- crawling-python
- html2markdown