Need to add files into ipfs much faster

[batrlatom]

I would like to add few million small images into ipfs ( could be private network ), but adding is quite slow… like 1 file/second. I am using python ipfs-api. How can I do it 10-100 times faster?

[sebaseba]

@batrlatom

I would like to add few million small images into ipfs ( could be private network ), but adding is quite slow… like 1 file/second. I am using python ipfs-api. How can I do it 10-100 times faster?

What if you add it as a dir?

[batrlatom]

I need to have the ipfs hash for each file.

[leerspace]

If they don’t need to be pinned, then set pin to false when calling the API.

You might also be interested in trying the experimental badger datastore (ipfs init --profile=badgerds).