Which chunking algorithms are available?

From @JustinDrake on Thu Dec 22 2016 13:11:32 GMT+0000 (UTC)

The ipfs add command has the following flag:

-s, --chunker string - Chunking algorithm to use.

What chunking algorithms are available?

Copied from original issue: https://github.com/ipfs/faq/issues/214

From @JustinDrake on Thu Dec 22 2016 13:14:34 GMT+0000 (UTC)

See here. The default is to use a block size of DefaultBlockSize int64 = 1024 * 256. Another block size can be specified using size-*. There’s also the rabin-* chunker which uses rabin-[min]-[avg]-[max].

From @JustinDrake on Thu Dec 22 2016 13:18:42 GMT+0000 (UTC)

As far as I can tell, the Rabin chunker is a “Content Defined Chunker” to improve deduplication. See here.