🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
- wget
- browser-bookmarks
- pinboard
Repository Index
47,133 repositories indexed
1–24 of 37 · Most stars
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
- nlp
- machine-learning
- machine-learning-library
- bot
TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
ChatterBot is a machine learning, conversational dialog engine for creating chat bots
- chatterbot
- machine-learning
- chatbot
- python
C# application with primary purpose of farming Steam cards from multiple accounts simultaneously.
- steam
- steam-api
- steam-account
- steambot
Saves Discord chat logs to a file
Translated:orange_book: Chinese Xinhua Dictionary database. Includes xiehouyu (two-part allegorical sayings), idioms, words, and Chinese characters.
- data
- scraper
- chinese-traditional
- python3
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
- python
- machine-learning
- natural-language-processing
- web-mining
An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.
- telegram
- archive
- wayback-machine
- save-the-internet
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt, eBay Kleinanzeigen and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)
- fredy
- immowelt
- appartment
- appartments
A Go client library for the Twitter 1.1 API
- go
- golang
- go-library
Free and open-source employee onboarding platform. Onboard new hires through Slack or the web portal.
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
- xquery
- xml
- html
- json
captcha break based on opencv2, tesseract-ocr and some machine learning algorithm.
- machine-learning
- captcha
- opencv
- captcha-break
WarcDB: Web crawl data as SQLite databases.
Automating captcha solving for Playwright. Supports Cloudflare Turnstile & Interstitial, and reCAPTCHA V2 & V3 with Click-based or API (2captcha) solving. Designed for easy integration with Playwright, Patchright, and Camoufox.
- automation
- bot
- camoufox
- captcha
Zotero extension that combats link rot by archiving webpages and journal articles.
A Oembed consumer library, that gives you information about urls. It helps you replace urls to youtube or vimeo for example, with their html embed code. It has advanced features like offline support, responsive embeds and caching support.
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.
Send Sir Perceval on a quest to retrieve and gather data from software repositories.
- grimoirelab
- perceval
- data-mining
- data-fetching
TranslatedCNN | Keras/PyTorch | CAPTCHA recognition
- captcha
- cnn-keras
- machine-learning
- pytorch-cnn
Selfhosted. URL to PNG utility featuring parallel rendering using Playwright for screenshots and with storage caching via Local, S3, or CouchDB
Extract web archive data using Wayback Machine and Common Crawl
- golang
- crawler
- commoncrawl
- wayback-machine
Automatically starts machines based on incoming traffic, using smart local IP spoofing and Wake-on-LAN.
- automation
- c
- powermanagement
- server