Unable to fetch any CID from custom node

Help
, ,
1

Hello IPFS community,

I am running a service that consumes high amount of data from IPFS (18TB per month). As it gets quite expensive to load such amount of data with an external provider, I want to host a node of my own.

I have deployed a custom IPFS node on AWS using k8s, I have used the requests-ipfs Helm chart.

I was able to successfully start the node and I have been able to pin a content to the node and than retrieve it. However I am unable to download any CID not present on the node itself - the command hangs indefinitely.

Going through the list of suggested commands in the IPFS documentation I can see that I am connected to some peers

$ ipfs swarm peers

/ip4/34.90.200.227/tcp/4001/p2p/QmaSrBXFBaupfeGMTuigswtKtsthbVaSonurjTV967Fdxx
/ip4/35.204.165.3/tcp/4001/p2p/QmPBPgTDVjveRu6KjGVMYixkCSgGtVyV8aUe6wGQeLZFVd
/ip4/35.204.6.32/tcp/4001/p2p/QmYdcSoVNU1axgSnkRAyHtwsKiSvFHXeVvRonGCAV9LVEj

however I am not able to connect to the specified peer

$ ipfs swarm connect 

/dnsaddr/bootstrap.libp2p.io/p2p/QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN
Error: connect QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN failure: failed to dial QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN:
  * [/ip6/2604:1380:45e3:6e00::1/tcp/443/wss] failed to WebSocket dial: failed to send handshake request: Get "https://[2604:1380:45e3:6e00::1]:443": dial tcp [2604:1380:45e3:6e00::1]:443: connect: cannot assign requested address
  * [/ip6/2604:1380:45e3:6e00::1/tcp/4001] dial tcp6 [2604:1380:45e3:6e00::1]:4001: connect: cannot assign requested address
  * [/ip4/139.178.91.71/tcp/4001] failed to negotiate security protocol: privnet: could not read full nonce
  * [/ip4/139.178.91.71/tcp/443/wss] failed to WebSocket dial: failed to send handshake request: Get "https://139.178.91.71:443": x509: cannot validate certificate for 139.178.91.71 because it doesn't contain any IP SANs

nor am I able to find route to a peer

$ ipfs dht findpeer QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN
Error: routing: not found

Do you have any suggestion, what might be the issue?

This is my IPFS version

$ ipfs --version
ipfs version 0.21.0-dev

Here is my config

{
  "API": {
    "HTTPHeaders": {
      "Access-Control-Allow-Origin": [
        "*"
      ]
    }
  },
  "Addresses": {
    "API": "/ip4/0.0.0.0/tcp/5001",
    "Announce": [],
    "Gateway": "/ip4/0.0.0.0/tcp/8080",
    "NoAnnounce": [],
    "Swarm": [
      "/ip4/0.0.0.0/tcp/4001",
      "/ip6/::/tcp/4001",
      "/ip4/0.0.0.0/udp/4001/quic",
      "/ip4/0.0.0.0/udp/4001/quic-v1",
      "/ip4/0.0.0.0/udp/4001/quic-v1/webtransport",
      "/ip6/::/udp/4001/quic",
      "/ip6/::/udp/4001/quic-v1",
      "/ip6/::/udp/4001/quic-v1/webtransport"
    ]
  },
  "Bootstrap": [
    "/dns4/ipfs-survival.request.network/tcp/4001/p2p/Qmb6a5DH45k8JwLdLVZUhRhv1rnANpsbXjtsH41esGhNCh",
    "/dns4/ipfs-2.request.network/tcp/4001/p2p/QmPBPgTDVjveRu6KjGVMYixkCSgGtVyV8aUe6wGQeLZFVd",
    "/dns4/ipfs-bootstrap-2.request.network/tcp/4001/p2p/QmYdcSoVNU1axgSnkRAyHtwsKiSvFHXeVvRonGCAV9LVEj",
    "/dns4/ipfs-bootstrap.request.network/tcp/4001/p2p/QmaSrBXFBaupfeGMTuigswtKtsthbVaSonurjTV967Fdxx"
  ],
  "Datastore": {
    "BloomFilterSize": 0,
    "GCPeriod": "1h",
    "HashOnRead": false,
    "Spec": {
      "mounts": [
        {
          "child": {
            "path": "blocks",
            "shardFunc": "/repo/flatfs/shard/v1/next-to-last/2",
            "sync": true,
            "type": "flatfs"
          },
          "mountpoint": "/blocks",
          "prefix": "flatfs.datastore",
          "type": "measure"
        },
        {
          "child": {
            "compression": "none",
            "path": "datastore",
            "type": "levelds"
          },
          "mountpoint": "/",
          "prefix": "leveldb.datastore",
          "type": "measure"
        }
      ],
      "type": "mount"
    },
    "StorageGCWatermark": 90,
    "StorageMax": "10GB"
  },
  "Discovery": {
    "MDNS": {
      "Enabled": false,
      "Interval": 10
    }
  },
  "Experimental": {
    "FilestoreEnabled": false,
    "Libp2pStreamMounting": false,
    "P2pHttpProxy": false,
    "PreferTLS": false,
    "QUIC": true,
    "ShardingEnabled": false,
    "UrlstoreEnabled": false
  },
  "Gateway": {
    "APICommands": [],
    "HTTPHeaders": {
      "Access-Control-Allow-Headers": [
        "X-Requested-With",
        "Range",
        "User-Agent"
      ],
      "Access-Control-Allow-Methods": [
        "GET"
      ],
      "Access-Control-Allow-Origin": [
        "*"
      ]
    },
    "NoFetch": false,
    "PathPrefixes": [],
    "RootRedirect": "",
    "Writable": false
  },
  "Identity": {
    "PeerID": "QmW9KeYYf9xCq6KRiuLY6FqNCiQrFrEoJJ8rgCr2or4yd1"
  },
  "Ipns": {
    "RecordLifetime": "",
    "RepublishPeriod": "",
    "ResolveCacheSize": 128
  },
  "Mounts": {
    "FuseAllowOther": false,
    "IPFS": "/ipfs",
    "IPNS": "/ipns"
  },
  "Pubsub": {
    "DisableSigning": false,
    "Router": "",
    "StrictSignatureVerification": false
  },
  "Reprovider": {},
  "Routing": {
    "Type": "dht"
  },
  "Swarm": {
    "AddrFilters": null,
    "ConnMgr": {
      "GracePeriod": "20s",
      "HighWater": 1000,
      "LowWater": 50,
      "Type": "basic"
    },
    "DisableBandwidthMetrics": true,
    "DisableNatPortMap": false,
    "DisableRelay": false,
    "EnableAutoNATService": false,
    "EnableAutoRelay": false,
    "EnableRelayHop": false
  }
}```
1 Like
2

I’m not sure I can help with your problem but I’m surprised no one has asked, what are you doing with IPFS where you’re downloading 18TB/mo?