🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
- pocket
- wget
- browser-bookmarks
- pinboard
Build a portrait of your life. Assistants that know you. Clones that talk like you.
TranslatedA multi-task real-time/scheduled monitoring and intelligent analysis system for Xianyu (闲鱼), built with Playwright and AI, and equipped with a full-featured back-end management UI. It helps users find the products they like among the vast number of items on Xianyu.
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
Pythonic HTML Parsing for Humans™
Download pictures (or videos) along with their captions and other metadata from Instagram.
- instagram
- instagram-client
- instagram-feed
- downloader
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
TranslatedWeChat assistant: 1. Sends customized messages to friends (a girlfriend) at scheduled times every day. 2. A bot automatically replies to friends. 3. Group assistant features (for example: looking up garbage sorting, weather, calendar, real-time movie box office, express delivery tracking, PM2.5, etc.)
Real-time monitor and web admin for Celery distributed task queue
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Dark Web OSINT Tool
- tor
- tor-network
- deepweb
- dark-web
Translated[Captcha Recognition - Training] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.
My tensorflow implementation of "A neural conversational model", a Deep learning based chatbot
Find web directories without bruteforce
Translated者也 (Zheye, "zhe ye", classical Chinese particles) - Zhihu upside-down text Chinese character captcha recognition program
Tor Browser automation with Selenium.
A Python feed reader library.
Translated✈️ Self-hosted multi-channel airfare price monitoring: flight detail collection → DingTalk rich-media push → four-layer strong alerts when the target price is met. Domestic routes and international routes (destinations on five continents) share the same collect-judge-push pipeline; data stays on your own machine, all configuration is done on a web page, open source and free.
A lightweight system to automate posting to all of your socials from one dashboard
Maze Applied Reinforcement Learning Framework
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
Free Instagram view booster for Reels, Stories and Videos. Increase views, reach and engagement with smart delivery system. Easy to use, multiple safety modes, fully configurable.
- 2026
- configuration
- engagement
- free