Supporting Large IPLD Blocks

Thanks for sharing.

Regarding small blocks as a means for deduplication, I recently looked into this and shared why I think this is not the right trade-off if you consider the cost of announcements, and CID determinism and traversing DAGs over the network. Here’s the post where I elaborate on this:

As for deduplication more broadly, I’d check out content defined chunking (CDC) and the following paper: Analysis and Comparison of Deduplication Strategies in IPFS

1 Like