# Scaling of IPFS for storage of 10 million+ small files

**URL:** <https://discuss.ipfs.tech/t/scaling-of-ipfs-for-storage-of-10-million-small-files/15855>\
**Category:** Help\
**Created:** [January 18, 2023, 6:25pm UTC](https://discuss.ipfs.tech/t/scaling-of-ipfs-for-storage-of-10-million-small-files/15855 "2023-01-18T18:25:19Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![ipfswonder](https://avatars.discourse-cdn.com/v4/letter/i/e9bcb4/32.png) [@ipfswonder](https://discuss.ipfs.tech/u/ipfswonder)\
**Post date:** [January 18, 2023, 6:25pm UTC](https://discuss.ipfs.tech/t/scaling-of-ipfs-for-storage-of-10-million-small-files/15855/1 "2023-01-18T18:25:19Z")

</div>

Hello,

We are looking to deploy an NFT project which would rely on IPFS for storage. However, we are looking to get more information on how scalable this is, as we have a little over 10 million PNG files (approx. 5 kb each).

Mainly, we are wondering if it is possible to upload and pin these files in a scalable manner.

Is this currently possible with IPFS? Are there any solutions to make this process easier? Can webhooks be incorporated on a project of this many files to update metadata as needed?

Thank you for the help!

---

<div class="post-metadata">

**Author:** ![filebase](https://avatars.discourse-cdn.com/v4/letter/f/898d66/32.png) [@filebase](https://discuss.ipfs.tech/u/filebase)\
**Post date:** [January 18, 2023, 7:10pm UTC](https://discuss.ipfs.tech/t/scaling-of-ipfs-for-storage-of-10-million-small-files/15855/2 "2023-01-18T19:10:50Z")

</div>

We’d love to help at [Filebase](https://filebase.com) - Give things a try and let us know if you want to chat!

Our S3-Compatible API, Multipart Upload Support and much more should make things very simple/easy for you to integrate.

---

<div class="post-metadata">

**Author:** ![danieln](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/danieln/32/6408_2.png) [@danieln](https://discuss.ipfs.tech/u/danieln)\
**Post date:** [January 23, 2023, 11:49am UTC](https://discuss.ipfs.tech/t/scaling-of-ipfs-for-storage-of-10-million-small-files/15855/3 "2023-01-23T11:49:19Z")

</div>

IPFS should be able to handle this scale; it’s more a question of the specific infrastructure to which you deploy IPFS or specific pinning service you decide to use.

> [@ipfswonder](#):
>
> Mainly, we are wondering if it is possible to upload and pin these files in a scalable manner.

I recommend checking out [NFT.storage](https://nft.storage/), which is a pinning service that uses a [hyper scalable implementation of IPFS](https://blog.nft.storage/posts/2022-07-06-elastic-ipfs).

To get a sense of NFT.storage’s magnitude, here are some numbers from [their stats page](https://nft.storage/stats/):

 ![Screenshot 2023-01-23 at 12.42.04 PM](https://us1.discourse-cdn.com/flex020/uploads/ipfs1/original/2X/1/11628e4e94e6a7603b62eb62f19a71e01d236c5f.png)

> [@ipfswonder](#):
>
> Are there any solutions to make this process easier?

The NFT.storage quickstart guide has a number of their tools for uploading: [Welcome](https://nft.storage/docs/quickstart/)

> [@ipfswonder](#):
>
> Can webhooks be incorporated on a project of this many files to update metadata as needed?

What are you trying to do with webhooks exactly? Tracking the progress of the upload process?

It may make sense to write a custom upload script that tracks the progress of the whole process in a local file or an SQLite DB.

Maybe you can share more information on what you mean by updating metadata?