⬛️ GUI/CLI tool and library for saving complete web pages as a single HTML file
- save-the-internet
- procrastination
- its-mine
- no-more-404
102,118 visible repositories in the index
1–24 of 30 · Most stars
⬛️ GUI/CLI tool and library for saving complete web pages as a single HTML file
The Unofficial TikTok API Wrapper In Python
💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
Successor of Undetected-Chromedriver. Providing a blazing fast framework for web automation, webscraping, bots and any other creative ideas which are normally hindered by annoying anti bot systems like Captcha / CloudFlare / Imperva / hCaptcha
:zap: A distributed crawler for weibo, building with celery and requests.
Downloads albums from the web in bulk for archive purposes
Stay on top of trending topics on social media and the web with AI
Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API access, and a generous free plan with 200 searches/month.
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Utilities for downloading the EPG (Electronic Program Guide) for thousands of TV channels from hundreds of sources.
Use Google News Scraper API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.
The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.
🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos/videos, contact information, followers, following and much more.
A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
A CLI utility for taking screenshots of websites, recording video demos and scraping sites using JavaScript
Real time google image scraper. The process is automated by sending HTTP requests to retrieve image data which is then parsed and saved.
Cloud browser infrastructure and web automation platform for your AI and coding agents
简单易用的Python爬虫框架,QQ交流群:597510560
Download website to local directory (including all css, images, js, etc.)
Core Python Web Archiving Toolkit for replay and recording of web archives
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt, eBay Kleinanzeigen and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)