From @JustinDrake on Thu Dec 22 2016 13:11:32 GMT+0000 (UTC)
ipfs add command has the following flag:
-s, --chunker string - Chunking algorithm to use.
What chunking algorithms are available?
Copied from original issue: https://github.com/ipfs/faq/issues/214
From @JustinDrake on Thu Dec 22 2016 13:14:34 GMT+0000 (UTC)
See here. The default is to use a block size of
DefaultBlockSize int64 = 1024 * 256. Another block size can be specified using
size-*. There’s also the
rabin-* chunker which uses
From @JustinDrake on Thu Dec 22 2016 13:18:42 GMT+0000 (UTC)
As far as I can tell, the Rabin chunker is a “Content Defined Chunker” to improve deduplication. See here.