# Public gateways will not retrieve my files 😔

**URL:** <https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247>\
**Category:** Help\
**Created:** [September 7, 2019, 6:50am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247 "2019-09-07T06:50:12Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![ashley-crux](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/ashley-crux/32/3043_2.png) [@ashley-crux](https://discuss.ipfs.tech/u/ashley-crux)\
**Post date:** [September 7, 2019, 6:50am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/1 "2019-09-07T06:50:12Z")

</div>

I’ve been trying for hours, forwarding ports, monitoring network traffic, and trying various computers (desktop, laptop, DigitalOcean droplet). I cannot retrieve my files over any public gateway. Port 4001 is open. It still doesn’t work. Just endless loading until an eventual timeout. 😔 😔 🍌

EDIT: I’ve also used my mobile phone and I tend to have around 120 peers.

EDIT: I’m drunk and I’m going to tear my hair out. 😡

EDIT: Nevermind. It was just taking like 20 minutes to load. It works now. Just kinda slow on the upload.

---

<div class="post-metadata">

**Author:** ![talb](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/talb/32/3022_2.png) [@talb](https://discuss.ipfs.tech/u/talb)\
**Post date:** [September 7, 2019, 4:37pm UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/2 "2019-09-07T16:37:17Z")

</div>

That was a roller-coaster of emotions.

---

<div class="post-metadata">

**Author:** ![hector](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/hector/32/178_2.png) [@hector](https://discuss.ipfs.tech/u/hector)\
**Post date:** [September 9, 2019, 9:31am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/3 "2019-09-09T09:31:50Z")

</div>

Hey,

would you be able to verify your peer is diallable from the outside?

1. `ipfs id` should show an external IP and port
2. `curl <ext_ip>:<ext_port`\> should connect (hopefully from a different computer)

Depending on the setup, opening port 4001 in the router may not help, because IPFS sets up upnp on a different port, and/or the detected external port is the NAT one from the router (the main thing here is what is the port shown by `ipfs id` next to the external IP). If upnp does not work then the peer is not dialable. The actual IP/port can be overriden with the `Announce` parameter in the config.

Then, assuming your peer is diallable or has found a relay to become diallable, the gateway will have to find it. This is where the public gateway health and the general state of the DHT come into play (both for the content your peer is providing and for the content the gateways are retrieving). For those things, we are working very hard on improving reliability of the network.

Which gateways did you try and from which location?

---

<div class="post-metadata">

**Author:** ![spudwa](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/spudwa/32/3063_2.png) [@spudwa](https://discuss.ipfs.tech/u/spudwa)\
**Post date:** [September 9, 2019, 10:26am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/4 "2019-09-09T10:26:06Z")

</div>

ok I can confirm my peer is diallable from the outside. Your curl test gets a 404  
I opened up the firewall on azure and I can access the IPFS webgui from my laptop which is on a different network.

In all my testing (not very much) whenever I cut and paste a cid QM… into the explore box the three dots just keep spinning. I’ve only ever been able to access XKCD etc I had assumed that if I could discover a peer I could ‘ls’ it etc. Question If someone has set up a node but hasn’t added a file would that cause problems. Can you see my file?

---

<div class="post-metadata">

**Author:** ![kf106](https://avatars.discourse-cdn.com/v4/letter/k/48db29/32.png) [@kf106](https://discuss.ipfs.tech/u/kf106)\
**Post date:** [September 9, 2019, 10:51am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/5 "2019-09-09T10:51:11Z")

</div>

I found the same thing too. It is just really really slow publishing your file hash on the DHT (if it manages it at all). The first file took 49 minutes to publish and become available (and hence for my other node to be able to find it). The second file didn’t publish after 14 hours. I was using DigitalOcean droplets, so no NAT problems. Which seems to be the knee-jerk reaction to any access problems you have.

Any command like `ipfs dht` or `ipfs provide` can take anywhere between minutes and hours to complete, if it completes at all.

---

<div class="post-metadata">

**Author:** ![spudwa](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/spudwa/32/3063_2.png) [@spudwa](https://discuss.ipfs.tech/u/spudwa)\
**Post date:** [September 9, 2019, 11:15am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/6 "2019-09-09T11:15:02Z")

</div>

yes that’s the conclusion I’m coming to as well. I’ve just done a ‘ipfs ls’ from the command line on all the cid’s listed on the Explore tab and they all work. The reason I set up my IPFS node on azure was so I could leave it running all the time. Can you keep trying and see when I’m visible to you?

---

<div class="post-metadata">

**Author:** ![hector](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/hector/32/178_2.png) [@hector](https://discuss.ipfs.tech/u/hector)\
**Post date:** [September 9, 2019, 11:46am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/7 "2019-09-09T11:46:19Z")

</div>

There are two things here. If you are talking about [explore.ipld.io](http://explore.ipld.io), this seems to use a js-ipfs embedded node. Since js-ipfs does not have DHT-discover/routing, it relies on something we call preloader nodes to fetch that content from the main dht.

[explore.ipld.io](http://explore.ipld.io) is different from [gateway.ipfs.io](http://gateway.ipfs.io) on how content is fetched (they use different infrastructure).

> [@kf106](#):
>
> Which seems to be the knee-jerk reaction to any access problems you have.

The reason why it takes so long to provide records on the DHT is that most peers in it (where those records should go) are not diallable therefore the provider calls keep searching for longer for appropiate peers. Undiallable nodes are a big issue right now even if your single node is but we are working on improving this!

Note that go-ipfs now support different providing strategies. See [https://github.com/ipfs/go-ipfs/blob/master/docs/config.md#reprovider](https://github.com/ipfs/go-ipfs/blob/master/docs/config.md#reprovider) and also try [https://github.com/ipfs/go-ipfs/blob/master/docs/experimental-features.md#strategic-providing](https://github.com/ipfs/go-ipfs/blob/master/docs/experimental-features.md#strategic-providing) . Depending on the amount of content you have, this may improve how fast things are provided. You may also try increasing the connection manager settings to increase the limit on the total number of peers (to 2500 for example).

---

<div class="post-metadata">

**Author:** ![spudwa](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/spudwa/32/3063_2.png) [@spudwa](https://discuss.ipfs.tech/u/spudwa)\
**Post date:** [September 9, 2019, 12:00pm UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/8 "2019-09-09T12:00:07Z")

</div>

I can browse [explore.ipld.io](http://explore.ipld.io) but [gateway.ipfs.io](http://gateway.ipfs.io) gives 404. So I’m adding to my mental model, just because I can see a peer doesn;t mean I can ls|get their files. Correct? I’ll try increasing my peer limit.  
Question does IPFS watch the config file ie. do I have to manually restart after re-config?

---

<div class="post-metadata">

**Author:** ![spudwa](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/spudwa/32/3063_2.png) [@spudwa](https://discuss.ipfs.tech/u/spudwa)\
**Post date:** [September 11, 2019, 2:33am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/9 "2019-09-11T02:33:06Z")

</div>

Ok I increased my peer limit to 1900 and left it for a few hours, but I still can’t ‘explore’ random Qm’s just XKCD etc. I set up on Azure so I can run 24/7 as I suspected that people running for a few hours will not really help the reliability of ipfs. I got into ipfs through torrent paradise and he explains the importance of running 24/7 and pinning. I’m running nohup ipfs daemon& from the command line but I’d appreciate instructions for setting up a service on Windows Mac and Linux. This would help you as much as me

---

<div class="post-metadata">

**Author:** ![hector](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/hector/32/178_2.png) [@hector](https://discuss.ipfs.tech/u/hector)\
**Post date:** [September 12, 2019, 9:53am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/10 "2019-09-12T09:53:57Z")

</div>

> but [gateway.ipfs.io](http://gateway.ipfs.io) gives 404

What gateway url are you calling?

> I have to manually restart after re-config?

Yes

> I’m running nohup ipfs daemon& from the command line but I’d appreciate instructions for setting up a service on Windows Mac and Linux

There are a few tutorials around. i.e. [Set up IPFS node on the server - Michal Zalecki](https://michalzalecki.com/set-up-ipfs-node-on-the-server/)

---

<div class="post-metadata">

**Author:** ![spudwa](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/spudwa/32/3063_2.png) [@spudwa](https://discuss.ipfs.tech/u/spudwa)\
**Post date:** [September 12, 2019, 11:49am UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/11 "2019-09-12T11:49:57Z")

</div>

[https://gateway.ipfs.io/ipfs/QmRdzqKJPVzjaUJsfFDyUdvZdAn3eidAAyQtehNczv2hmc](https://gateway.ipfs.io/ipfs/QmRdzqKJPVzjaUJsfFDyUdvZdAn3eidAAyQtehNczv2hmc) my own gateway

Next problem…

echo “

# Michal
” \> index.html  
ipfs add index.html  
ipfs cat Qma1PYYMwbgR3GBscmBV7Zx8YgWdhBUAY6z27TznhrBet9Qma1PYYMwbgR3GBscmBV7Zx8YgWdhBUAY6z27TznhrBet9  
Error: invalid path “Qma1PYYMwbgR3GBscmBV7Zx8YgWdhBUAY6z27TznhrBet9Qma1PYYMwbgR3GBscmBV7Zx8YgWdhBUAY6z27TznhrBet9”: selected encoding not supported

---

<div class="post-metadata">

**Author:** ![hector](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/hector/32/178_2.png) [@hector](https://discuss.ipfs.tech/u/hector)\
**Post date:** [September 27, 2019, 12:54pm UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/12 "2019-09-27T12:54:12Z")

</div>

`Qma1PYYMwbgR3GBscmBV7Zx8YgWdhBUAY6z27TznhrBet9Qma1PYYMwbgR3GBscmBV7Zx8YgWdhBUAY6z27TznhrBet9` is clearly `Qma1PYYMwbgR3GBscmBV7Zx8YgWdhBUAY6z27TznhrBet9` concatenated twice…

---

<div class="post-metadata">

**Author:** ![lyrx](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ipfs.tech/lyrx/32/3019_2.png) [@lyrx](https://discuss.ipfs.tech/u/lyrx)\
**Post date:** [September 27, 2019, 1:38pm UTC](https://discuss.ipfs.tech/t/public-gateways-will-not-retrieve-my-files/6247/13 "2019-09-27T13:38:17Z")

</div>

Here is the real problem: You can make a lot of mistakes/typos in the process. And even if you do everything right, content resolution can still be very slow, too slow sometimes …
