🛠️ Hashsync – Deduplicate SSH streams against the receiver's files
Summary
Hashsync is a transparent pipe that runs over SSH and deduplicates command input or output against an index of the receiving host's files. It searches at every byte offset of a stream to find blocks from indexed files, reducing bandwidth usage for tools like rsync and nix-copy-closure.
Why it’s interesting
It performs block-level deduplication across an entire set of indexed files at any byte offset of a stream, functioning as a transparent pipe for existing SSH tools.
Target user
Developers and system administrators using SSH for backups, file transfers, or NixOS updates over limited bandwidth connections.
Source metrics: Points 2 · Comments 0
HN discussion · Project
Source: #HackerNews / Show HN
Summary
Hashsync is a transparent pipe that runs over SSH and deduplicates command input or output against an index of the receiving host's files. It searches at every byte offset of a stream to find blocks from indexed files, reducing bandwidth usage for tools like rsync and nix-copy-closure.
Why it’s interesting
It performs block-level deduplication across an entire set of indexed files at any byte offset of a stream, functioning as a transparent pipe for existing SSH tools.
Target user
Developers and system administrators using SSH for backups, file transfers, or NixOS updates over limited bandwidth connections.
Source metrics: Points 2 · Comments 0
HN discussion · Project
Source: #HackerNews / Show HN