Portable file server with accelerated resumable uploads, dedup, WebDAV, SFTP, FTP, TFTP, zeroconf, media indexer, thumbnails++ all in one file
- nas-frontend
- file-sharing
- file-server
- file-upload-server
102,118 visible repositories in the index
1–24 of 36 · Most stars
Portable file server with accelerated resumable uploads, dedup, WebDAV, SFTP, FTP, TFTP, zeroconf, media indexer, thumbnails++ all in one file
Fast, secure, efficient backup program
Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
Deduplicating archiver with compression and authenticated encryption.
TranslatedA practical Douyin downloader for both single-item and profile batch downloads, with progress display, retries, SQLite deduplication, and browser fallback support. Douyin batch download tool, removes watermarks, supports videos, image albums, collections, and music (original sound).
Prometheus Alertmanager
Find duplicate files
Very efficient backup system based on the git packfile format, providing fast incremental saves and global deduplication (among and within files, including virtual machine images). Please post problems or patches to the mailing list for discussion (see the end of the README below).
😎 Finding duplicate images made easy!
A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
Windows disk usage analyzer and cleanup tool with interactive treemaps, large-file discovery, duplicate detection, and file-system monitoring.
:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
rustic - fast, encrypted, and deduplicated backups powered by Rust
Ephemeral Workspaces, durable shared history. LayerFS gives every agent a complete, writable filesystem Workspace over shared committed history, without copying the base. Agents work in parallel, commit what changed as deduplicated checkpoints, then branch, rewind or merge. Try it with LayerFS × DSH.
A fast high-compression read-only file system for Linux, FreeBSD, macOS and Windows
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
Extremely fast tool to remove duplicates and other lint from your filesystem
Mirror of borgmatic: Simple, configuration-driven backup software for servers and workstations
Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.
plakar is a backup solution powered by Kloset and ptar
Config driven, easy backup cli for restic.
Scalable data pre processing and curation toolkit for LLMs
Replace complex Borg Backup terminal commands with a beautiful web UI. Create, schedule, and restore backups with just a few clicks.
s3git: git for Cloud Storage. Distributed Version Control for Data. Create decentralized and versioned repos that scale infinitely to 100s of millions of files. Clone huge PB-scale repos on your local SSD to make changes, commit and push back. Oh yeah, it dedupes too and offers directory versioning.