⬛️ GUI/CLI tool and library for saving complete web pages as a single HTML file
- save-the-internet
- procrastination
- its-mine
- no-more-404
Repository Index
84,583 visible repositories in the index
1–14 of 14 · Most stars
Make optimisation of images part of your automated build process
- imageoptim
- image-optimisation
- jpegmini
- pngquant
AutoCLI is a Blazing fast, memory-safe command-line tool — Fetch information from any website with a single command. Covers Twitter/X, Reddit, YouTube, HackerNews, Bilibili, Zhihu, Xiaohongshu, and 55+ sites, with support for controlling Electron desktop apps, integrating local CLI tools (gh, docker, kubectl), now powered by AutoCLI.ai .
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
HTML parsing and querying with CSS selectors
- hacktoberfest
- rust
Cross platform input simulation in Rust
- input
- cross-platform
- mouse
- keyboard
Type-safe, extensible, and high-performance background processing library for Rust
- background-jobs
- rust
- postgres
- redis
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
- meta-search-engine
- rust
- search-engine
- fast
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
- ai-agents
- browser-automation
- data-extraction
- firecrawl
🩵 Self-hosted & Fully-automated ActivityPub Bridge for Static Sites.
- activitypub
- federation
- fediverse
- rust
A Fediverse and Bluesky bot to post trending rust repositories, inspired by TrendingGithub
- trending-rust-repositories
- rust
- rust-lang
- mastodon
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
- crawling
- csharp
- elixir
- ffi
A robust web archive analytics toolkit
- python
- web
- warc
- bigdata
:game_die: Native language APIs for building messages using the Slack Block Kit API