We are storing large array-type data in the zarr format [1]. The zarr format, in theory, is well suited for being distributed through ipfs because it is stored as chunks plus metadata in JSON. There even have been some effort to map the format directly to IPLD [2]. For good performance, the correct…

The blocksize is not your problem here. I have some code there which runs at GiB/s speed with 256KiB block sizes New very fast unixfs implementation. by Jorropo · Pull Request #347 · ipfs/boxo · GitHub . Iroh uses ~4KiB block sizes yet it’s extremely fast too. ipfs get is not very optimized and end…

Any plans to increas maximum block size?

Help

danieln February 16, 2024, 10:28am 2

The most elaborate discussion on the topic that I’m aware of can be found in this thread Supporting Large IPLD Blocks

1 Like

Topic		Replies	Views
What is the maximum IPFS block size IPFS	3	1466	October 18, 2021
Customizing block layout for files IPFS	2	564	September 15, 2018
Supporting Large IPLD Blocks Protocol ipld	18	1362	February 16, 2024
Unixfs and the 1MB block limit Help go-ipfs	2	669	July 24, 2017
Does IPFS provide block-level file copying feature?	11	2283	January 9, 2020

Any plans to increas maximum block size?

Related topics