For example userA added a file sized 1 GB. ipfs add file.txt and userB get that file into his storage through ipfs. Later userA released a mistake and changed only a single character on the file and wants to share this updated version with userB. At this point what is the best solution via IPFS to s…

I think you are wrong! Further investigation: I did a small experiment. First I have added 1GB file into IPFS. Later, I have updated a small line on the file, that is already shared via IPFS. I observe that userA pushes complete 1GB file all over again, instead only pushing the block that contain…

ipfs add of course has to chunk-and-hash the whole file again, since it cannot know only one chunk is changed until after it has done that. You never pin to userB, this is probably not an issue (since you probably did not run GC during your test) but in theory could be. Running ipfs get / cat alwa…

Sorry I got lost where should I do pinning. Could you give an example? Should userB pin the object after he get the first hash? Something like: $ ipfs get QmdiETTY5fiwTkJeERbWAbPKtzcyjzMEJTJJosrqo2qKNm $ sudo ipfs pin add QmdiETTY5fiwTkJeERbWAbPKtzcyjzMEJTJJosrqo2qKNm pinned QmdiETTY5fiwTkJeE…

[image] avatar-lavventura: After I pinned the first hash than try to download its second version, again it downloaded the complete file. Just because ipfs get writes out a 1GB file, that doesn’t mean it needed to redownload all of it again. Some of it could be cached. ipfs get or ipfs cat nec…

Main goal of using ipfs pin is the keep the files in the cache right? So the reason I need to ipfs pin is to prevent ipfs garbage collector to remove that file? But on userB whenever I do ipfs get <hash> . It keep does: Saving file(s) to Qmew8yVjNzs2r54Ti6R64W9psxYFd16X3yNY28gZS4YeM3 302.49 MB /…

[image] avatar-lavventura: Main goal of using ipfs pin is the keep the files in the cache right? So the reason I need to ipfs pin is to prevent ipfs garbage collector to remove that file? Yes, but garbage collection doesn’t run automatically by default. And I don’t see where you’re running i…

I was personally under the impression that you have to redownload the whole file, which it seems like your tests show to be the case. This is something that the Bluzelle project is trying to get around (database file storage so you don’t need to upload/download entire datasets written in one file ju…

@dennisonb I was on the same impression, but based on the other’s comments I believe only the changed block is downloaded (I have not tested it).

@leerspace I tried your suggestion and observe following, both have the same increase on the repo size: First I create 100 MB file ( file.txt) NumObjects: 5303 RepoSize: 181351841 StorageMax: 10000000000 RepoPath: /home/alper/.ipfs Version: fs-repo@6 $ ipfs add file.txt added QmZ33L…

Efficiency of IPFS for sharing updated file

singpolyma May 14, 2018, 7:26pm 2

They will not fetch the full 1GB, only the block that contains the changed character

How ipfs able to detect to download only block that contains the changed character?

Does IPFS provide block-level file copying feature?

Topic		Replies	Views
Does IPFS provide block-level file copying feature?	11	2396	January 9, 2020
How ipfs able to detect to download only block that contains the changed character?	0	365	July 24, 2019
Create text data ipfs file into folder hash by 1 API call js-ipfs	0	319	July 31, 2020
Is js-ipfs-git on the roadmap ? And a question about delta-encoding of IPLD Help js-ipfs , ipld	1	405	March 16, 2022
File hash is different from original Help	28	2143	September 16, 2020

Efficiency of IPFS for sharing updated file

Related topics