IPFS, zsync, ZIM and maximizing deduplication

zsync, the advanced file download tool that helps keep things in sync, is having a rewrite: zsync2


ZIM is a binary file format in which Wikipedia snapshots are produced by the Kiwix project and published at Index of /zim/wikipedia

One problem with .zim snapshots is that they are typically very large, hundreds of gigabytes for wikipedia, for example.