Sign in

Repository Index

102,118 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters

Filters

Clear all filters

1–24 of 36 · Most stars

Portable file server with accelerated resumable uploads, dedup, WebDAV, SFTP, FTP, TFTP, zeroconf, media indexer, thumbnails++ all in one file

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

TranslatedA practical Douyin downloader for both single-item and profile batch downloads, with progress display, retries, SQLite deduplication, and browser fallback support. Douyin batch download tool, removes watermarks, supports videos, image albums, collections, and music (original sound).

Very efficient backup system based on the git packfile format, providing fast incremental saves and global deduplication (among and within files, including virtual machine images). Please post problems or patches to the mailing list for discussion (see the end of the README below).

Windows disk usage analyzer and cleanup tool with interactive treemaps, large-file discovery, duplicate detection, and file-system monitoring.

  • disk-space-analyzer
  • treemap
  • windows
  • disk-usage-analyzer

:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

  • dedupe
  • record-linkage
  • python
  • python-library

Ephemeral Workspaces, durable shared history. LayerFS gives every agent a complete, writable filesystem Workspace over shared committed history, without copying the base. Agents work in parallel, commit what changed as deduplicated checkpoints, then branch, rewind or merge. Try it with LayerFS × DSH.

  • agent-infrastructure
  • ai-agents
  • checkpoint
  • content-addressable-storage

A fast high-compression read-only file system for Linux, FreeBSD, macOS and Windows

s3git: git for Cloud Storage. Distributed Version Control for Data. Create decentralized and versioned repos that scale infinitely to 100s of millions of files. Clone huge PB-scale repos on your local SSD to make changes, commit and push back. Oh yeah, it dedupes too and offers directory versioning.

  • cloud-storage
  • git
  • version-control
  • decentralized