IPFS peer is getting error when there is single `Bootstrap` peer

daniel1302 · May 24, 2023, 1:03pm

Background

The application’s responsibility is to put some database chunks(from PostgreSQL) into the IPFS network; then other nodes can use this data to load into PostgreSQL. It has many benefits as multiple nodes require the same data in the database.

Segment - this is how I call the database chunk; you can see this keyword in my application logs somewhere

The issue

I have an application that is starting the private IPFS network. The network works fine with multiple Bootstrap peers in the configuration.

However when I have only one node(let’s call it A) started. When I add a new node to the network, it has only one bootstrap peer(A). And I am getting the following errors:

I could not reproduce this issue with 2 Bootstrap peers.

What can cause the issue? Is there any requirement to have at least two nodes in the network?

Logs

You can find the ipfs logs here: IPFS logs · GitHub

Second node config

{
  "Identity": {
    "PeerID": "12D3KooWJpqacxjCYHzbbcoutMAM98TUaDtRgDbvSTtsym72VZRp",
    "PrivKey": "CAESQNWRZsagBeuFhMakswreOSf9TrDzFAEPHPj4DFA4qWGihdgtQuP4uZr1tbFjcbUkEG06SU4avHBClCNqhvoyNE8="
  },
  "Datastore": {
    "StorageMax": "10GB",
    "StorageGCWatermark": 90,
    "GCPeriod": "1h",
    "Spec": {
      "mounts": [
        {
          "child": {
            "path": "blocks",
            "shardFunc": "/repo/flatfs/shard/v1/next-to-last/2",
            "sync": true,
            "type": "flatfs"
          },
          "mountpoint": "/blocks",
          "prefix": "flatfs.datastore",
          "type": "measure"
        },
        {
          "child": {
            "compression": "none",
            "path": "datastore",
            "type": "levelds"
          },
          "mountpoint": "/",
          "prefix": "leveldb.datastore",
          "type": "measure"
        }
      ],
      "type": "mount"
    },
    "HashOnRead": false,
    "BloomFilterSize": 0
  },
  "Addresses": {
    "Swarm": [
      "/ip4/0.0.0.0/tcp/4045",
      "/ip4/0.0.0.0/udp/4045/quic",
      "/ip4/0.0.0.0/udp/4045/quic-v1",
      "/ip4/0.0.0.0/udp/4045/quic-v1/webtransport"
    ],
    "Announce": [],
    "AppendAnnounce": [],
    "NoAnnounce": [],
    "API": "/ip4/127.0.0.1/tcp/5001",
    "Gateway": "/ip4/127.0.0.1/tcp/8080"
  },
  "Mounts": {
    "IPFS": "/ipfs",
    "IPNS": "/ipns",
    "FuseAllowOther": false
  },
  "Discovery": {
    "MDNS": {
      "Enabled": false
    }
  },
  "Routing": {
    "Routers": null,
    "Methods": null
  },
  "Ipns": {
    "RepublishPeriod": "",
    "RecordLifetime": "",
    "ResolveCacheSize": 128
  },
  "Bootstrap": [
    "/ip4/127.0.0.1/tcp/4035/p2p/12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"
  ],
  "Gateway": {
    "HTTPHeaders": {
      "Access-Control-Allow-Headers": [
        "X-Requested-With",
        "Range",
        "User-Agent"
      ],
      "Access-Control-Allow-Methods": [
        "GET"
      ],
      "Access-Control-Allow-Origin": [
        "*"
      ]
    },
    "RootRedirect": "",
    "PathPrefixes": [],
    "APICommands": [],
    "NoFetch": false,
    "NoDNSLink": false,
    "PublicGateways": null
  },
  "API": {
    "HTTPHeaders": {}
  },
  "Swarm": {
    "AddrFilters": null,
    "DisableBandwidthMetrics": false,
    "DisableNatPortMap": false,
    "RelayClient": {},
    "RelayService": {},
    "Transports": {
      "Network": {},
      "Security": {},
      "Multiplexers": {}
    },
    "ConnMgr": {},
    "ResourceMgr": {
      "Limits": {}
    }
  },
  "AutoNAT": {},
  "Pubsub": {
    "Router": "",
    "DisableSigning": false
  },
  "Peering": {
    "Peers": null
  },
  "DNS": {
    "Resolvers": {}
  },
  "Migration": {
    "DownloadSources": [],
    "Keep": ""
  },
  "Provider": {
    "Strategy": ""
  },
  "Reprovider": {},
  "Experimental": {
    "FilestoreEnabled": false,
    "UrlstoreEnabled": false,
    "GraphsyncEnabled": false,
    "Libp2pStreamMounting": false,
    "P2pHttpProxy": false,
    "StrategicProviding": false,
    "AcceleratedDHTClient": false,
    "OptimisticProvide": false,
    "OptimisticProvideJobsPoolSize": 0
  },
  "Plugins": {
    "Plugins": null
  },
  "Pinning": {
    "RemoteServices": {}
  },
  "Internal": {}
}

First node config

{
  "Identity": {
    "PeerID": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs",
    "PrivKey": "CAESQMDGEBrDqEwtCtNmZC8a2qX1qTI+C5yUZeVw0E5TAmOF9j26wXxaOdOgtS+NoNU9LsAWfBMvH0omq7OYufTBHUo="
  },
  "Datastore": {
    "StorageMax": "10GB",
    "StorageGCWatermark": 90,
    "GCPeriod": "1h",
    "Spec": {
      "mounts": [
        {
          "child": {
            "path": "blocks",
            "shardFunc": "/repo/flatfs/shard/v1/next-to-last/2",
            "sync": true,
            "type": "flatfs"
          },
          "mountpoint": "/blocks",
          "prefix": "flatfs.datastore",
          "type": "measure"
        },
        {
          "child": {
            "compression": "none",
            "path": "datastore",
            "type": "levelds"
          },
          "mountpoint": "/",
          "prefix": "leveldb.datastore",
          "type": "measure"
        }
      ],
      "type": "mount"
    },
    "HashOnRead": false,
    "BloomFilterSize": 0
  },
  "Addresses": {
    "Swarm": [
      "/ip4/0.0.0.0/tcp/4035",
      "/ip4/0.0.0.0/udp/4035/quic",
      "/ip4/0.0.0.0/udp/4035/quic-v1",
      "/ip4/0.0.0.0/udp/4035/quic-v1/webtransport"
    ],
    "Announce": [],
    "AppendAnnounce": [],
    "NoAnnounce": [],
    "API": "/ip4/127.0.0.1/tcp/5001",
    "Gateway": "/ip4/127.0.0.1/tcp/8080"
  },
  "Mounts": {
    "IPFS": "/ipfs",
    "IPNS": "/ipns",
    "FuseAllowOther": false
  },
  "Discovery": {
    "MDNS": {
      "Enabled": false
    }
  },
  "Routing": {
    "Routers": null,
    "Methods": null
  },
  "Ipns": {
    "RepublishPeriod": "",
    "RecordLifetime": "",
    "ResolveCacheSize": 128
  },
  "Bootstrap": [
    "/ip4/127.0.0.1/tcp/4035/p2p/12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"
  ],
  "Gateway": {
    "HTTPHeaders": {
      "Access-Control-Allow-Headers": [
        "X-Requested-With",
        "Range",
        "User-Agent"
      ],
      "Access-Control-Allow-Methods": [
        "GET"
      ],
      "Access-Control-Allow-Origin": [
        "*"
      ]
    },
    "RootRedirect": "",
    "PathPrefixes": [],
    "APICommands": [],
    "NoFetch": false,
    "NoDNSLink": false,
    "PublicGateways": null
  },
  "API": {
    "HTTPHeaders": {}
  },
  "Swarm": {
    "AddrFilters": null,
    "DisableBandwidthMetrics": false,
    "DisableNatPortMap": false,
    "RelayClient": {},
    "RelayService": {},
    "Transports": {
      "Network": {},
      "Security": {},
      "Multiplexers": {}
    },
    "ConnMgr": {},
    "ResourceMgr": {
      "Limits": {}
    }
  },
  "AutoNAT": {},
  "Pubsub": {
    "Router": "",
    "DisableSigning": false
  },
  "Peering": {
    "Peers": null
  },
  "DNS": {
    "Resolvers": {}
  },
  "Migration": {
    "DownloadSources": [],
    "Keep": ""
  },
  "Provider": {
    "Strategy": ""
  },
  "Reprovider": {},
  "Experimental": {
    "FilestoreEnabled": false,
    "UrlstoreEnabled": false,
    "GraphsyncEnabled": false,
    "Libp2pStreamMounting": false,
    "P2pHttpProxy": false,
    "StrategicProviding": false,
    "AcceleratedDHTClient": false,
    "OptimisticProvide": false,
    "OptimisticProvideJobsPoolSize": 0
  },
  "Plugins": {
    "Plugins": null
  },
  "Pinning": {
    "RemoteServices": {}
  },
  "Internal": {}
}

daniel1302 · May 24, 2023, 1:03pm

The logs are following:

Info level

fetching history segment QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg (attempt 1, timeout 10s)
failed to fetch segment: could not get file with CID, connected peer addresses ,/ip4/127.0.0.1/tcp/4035: context deadline exceeded
fetching history segment QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg (attempt 2, timeout 20s)
failed to fetch segment: could not get file with CID, connected peer addresses ,/ip4/127.0.0.1/tcp/4035: context deadline exceeded
fetching history segment QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg (attempt 3, timeout 30s)
failed to fetch segment: could not get file with CID, connected peer addresses ,/ip4/127.0.0.1/tcp/4035: context deadline exceeded
fetching history segment QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg (attempt 4, timeout 40s)
failed to fetch segment: could not get file with CID, connected peer addresses ,/ip4/127.0.0.1/tcp/4035: context deadline exceeded
fetching history segment QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg (attempt 5, timeout 50s)

Debug logs


2023-05-24T14:52:58.496+0200	DEBUG	blockservice	blockservice/blockservice.go:247	BlockService: Searching
2023-05-24T14:52:58.496+0200	DEBUG	bitswap	getter/getter.go:86	Bitswap.GetBlockRequest.Start	{"cid": "QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg"}
2023-05-24T14:52:58.496+0200	INFO	bs:sess	session/session.go:460	No peers - broadcasting	{"session": 2, "want-count": 1}
2023-05-24T14:52:58.496+0200	DEBUG	bs:sess	session/session.go:467	broadcastWantHaves	{"session": 2, "cids": [{"/":"QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg"}]}
2023-05-24T14:52:59.496+0200	DEBUG	bs:sess	session/session.go:467	broadcastWantHaves	{"session": 2, "cids": [{"/":"QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg"}]}
2023-05-24T14:52:59.497+0200	DEBUG	bs:sess	session/session.go:361	FindMorePeers	{"session": 2, "cid": "QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg", "pending": 1}
2023-05-24T14:52:59.497+0200	DEBUG	bitswap	providerquerymanager/providerquerymanager.go:329	New Provider Query on cid: QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg
2023-05-24T14:52:59.497+0200	DEBUG	bitswap	providerquerymanager/providerquerymanager.go:234	Beginning Find Provider Request for cid: QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg
2023-05-24T14:52:59.497+0200	DEBUG	routing/composable	go-libp2p-routing-helpers/compparallel.go:432	getChannelOrErrorParallel: returning channel
2023-05-24T14:52:59.497+0200	DEBUG	routing/composable	go-libp2p-routing-helpers/compparallel.go:332	getChannelOrErrorParallel: starting execution for router &{0xc000e50a80 0xc000e51500} with timeout 0s and ignore errors true
2023-05-24T14:52:59.497+0200	DEBUG	routing/composable	go-libp2p-routing-helpers/compparallel.go:349	getChannelOrErrorParallel: calling router function for router &{0xc000e50a80 0xc000e51500} with timeout 0s and ignore errors true
2023-05-24T14:52:59.497+0200	DEBUG	dht	go-libp2p-kad-dht/routing.go:522	finding providers	{"cid": "QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg", "mh": "bciqcrj47pdzbkfvrif2emmktmckdcw32rbc4t5twtrdhfxm7i64jori"}
2023-05-24T14:52:59.497+0200	DEBUG	dht	go-libp2p-kad-dht/routing.go:522	finding providers	{"cid": "QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg", "mh": "bciqcrj47pdzbkfvrif2emmktmckdcw32rbc4t5twtrdhfxm7i64jori"}
2023-05-24T14:52:59.497+0200	DEBUG	routing/composable	go-libp2p-routing-helpers/compparallel.go:375	getChannelOrErrorParallel: getting channel value for router &{0xc000e50a80 0xc000e51500} with timeout 0s and ignore errors true closed channel: true
2023-05-24T14:52:59.497+0200	DEBUG	bitswap	providerquerymanager/providerquerymanager.go:329	Received provider (12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs) for cid (QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg)
2023-05-24T14:52:59.497+0200	DEBUG	bs:sprmgr	sessionpeermanager/sessionpeermanager.go:68	Bitswap: Added peer to session	{"session": 2, "peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "peerCount": 1}
2023-05-24T14:52:59.498+0200	DEBUG	dht	go-libp2p-kad-dht/routing.go:598	1 provider entries
2023-05-24T14:52:59.498+0200	DEBUG	dht	go-libp2p-kad-dht/routing.go:603	got provider: {12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs: [/ip4/172.21.18.199/tcp/4035 /ip4/127.0.0.1/tcp/4035]}
2023-05-24T14:52:59.498+0200	DEBUG	dht	go-libp2p-kad-dht/routing.go:624	got closer peers: 0 []
2023-05-24T14:52:59.498+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:52:59.499+0200	DEBUG	routing/composable	go-libp2p-routing-helpers/compparallel.go:375	getChannelOrErrorParallel: getting channel value for router &{0xc000e50a80 0xc000e51500} with timeout 0s and ignore errors true closed channel: false
2023-05-24T14:52:59.499+0200	DEBUG	routing/composable	go-libp2p-routing-helpers/compparallel.go:415	getChannelOrErrorParallel: finished executing all routers 1
2023-05-24T14:52:59.499+0200	DEBUG	bitswap	providerquerymanager/providerquerymanager.go:329	Finished Provider Query on cid: QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg
2023-05-24T14:53:00.497+0200	DEBUG	bs:sess	session/session.go:467	broadcastWantHaves	{"session": 2, "cids": [{"/":"QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg"}]}
2023-05-24T14:53:02.498+0200	DEBUG	bs:sess	session/session.go:467	broadcastWantHaves	{"session": 2, "cids": [{"/":"QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg"}]}
2023-05-24T14:53:03.447+0200	DEBUG	basichost	basic/basic_host.go:338	failed to fetch local IPv6 address	{"error": "no route found for ::"}
2023-05-24T14:53:05.499+0200	DEBUG	bs:sess	session/session.go:467	broadcastWantHaves	{"session": 2, "cids": [{"/":"QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg"}]}
2023-05-24T14:53:06.198+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:06.199+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ=="}
2023-05-24T14:53:06.199+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000236542}
2023-05-24T14:53:06.199+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000308787}
2023-05-24T14:53:06.199+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:06.200+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ=="}
2023-05-24T14:53:06.200+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqmyjikqcn6raxg3qkx7dlng6zzntafamkjkdmw7lm2ewzyq43ozpi"}
2023-05-24T14:53:06.200+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000275405}
2023-05-24T14:53:06.213+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:06.213+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ=="}
2023-05-24T14:53:06.213+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ==", "time": 0.000297015}
2023-05-24T14:53:06.213+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ==", "time": 0.000354142}
2023-05-24T14:53:06.214+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:06.214+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ=="}
2023-05-24T14:53:06.214+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqorc35chgaczfdhtdz7nqxiicbdh37nvmp7fatfwa3l3bydz256yi"}
2023-05-24T14:53:06.214+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ==", "time": 0.00018734}
2023-05-24T14:53:06.217+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:06.218+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ=="}
2023-05-24T14:53:06.218+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000163375}
2023-05-24T14:53:06.218+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.00021965}
2023-05-24T14:53:06.218+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:06.219+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ=="}
2023-05-24T14:53:06.219+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqmyjikqcn6raxg3qkx7dlng6zzntafamkjkdmw7lm2ewzyq43ozpi"}
2023-05-24T14:53:06.219+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000329205}
2023-05-24T14:53:06.261+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:06.262+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ=="}
2023-05-24T14:53:06.262+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000254876}
2023-05-24T14:53:06.262+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000304499}
2023-05-24T14:53:06.263+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:06.263+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ=="}
2023-05-24T14:53:06.263+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqmyjikqcn6raxg3qkx7dlng6zzntafamkjkdmw7lm2ewzyq43ozpi"}
2023-05-24T14:53:06.263+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000255428}
2023-05-24T14:53:08.447+0200	DEBUG	basichost	basic/basic_host.go:338	failed to fetch local IPv6 address	{"error": "no route found for ::"}
2023-05-24T14:53:09.500+0200	DEBUG	bs:sess	session/session.go:467	broadcastWantHaves	{"session": 2, "cids": [{"/":"QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg"}]}
2023-05-24T14:53:11.179+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.179+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "ACQIARIg9j26wXxaOdOgtS+NoNU9LsAWfBMvH0omq7OYufTBHUo="}
2023-05-24T14:53:11.179+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "ACQIARIg9j26wXxaOdOgtS+NoNU9LsAWfBMvH0omq7OYufTBHUo=", "time": 0.000268152}
2023-05-24T14:53:11.179+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "ACQIARIg9j26wXxaOdOgtS+NoNU9LsAWfBMvH0omq7OYufTBHUo=", "time": 0.000297817}
2023-05-24T14:53:11.180+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.180+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiAop5948hUWsUF0RjFTYJQxW3qIRcn2dpxGct2fR7iXRQ=="}
2023-05-24T14:53:11.180+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiAop5948hUWsUF0RjFTYJQxW3qIRcn2dpxGct2fR7iXRQ==", "time": 0.000212498}
2023-05-24T14:53:11.180+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiAop5948hUWsUF0RjFTYJQxW3qIRcn2dpxGct2fR7iXRQ==", "time": 0.000259275}
2023-05-24T14:53:11.181+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.181+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiAop5948hUWsUF0RjFTYJQxW3qIRcn2dpxGct2fR7iXRQ=="}
2023-05-24T14:53:11.181+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqcrj47pdzbkfvrif2emmktmckdcw32rbc4t5twtrdhfxm7i64jori"}
2023-05-24T14:53:11.181+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiAop5948hUWsUF0RjFTYJQxW3qIRcn2dpxGct2fR7iXRQ==", "time": 0.000376274}
2023-05-24T14:53:11.181+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.181+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ=="}
2023-05-24T14:53:11.181+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000095097}
2023-05-24T14:53:11.181+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000104405}
2023-05-24T14:53:11.182+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.182+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ=="}
2023-05-24T14:53:11.182+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqmyjikqcn6raxg3qkx7dlng6zzntafamkjkdmw7lm2ewzyq43ozpi"}
2023-05-24T14:53:11.182+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDMJQqAm+iC5twVf41tN7OWzAUDFJUNlvrZols4hzbsvQ==", "time": 0.000197319}
2023-05-24T14:53:11.182+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.182+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiBZlIQ5Bl8pYZ70EoDLuTK+UsVtmcWWa2XgERI58Ji77w=="}
2023-05-24T14:53:11.182+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiBZlIQ5Bl8pYZ70EoDLuTK+UsVtmcWWa2XgERI58Ji77w==", "time": 0.000115275}
2023-05-24T14:53:11.182+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiBZlIQ5Bl8pYZ70EoDLuTK+UsVtmcWWa2XgERI58Ji77w==", "time": 0.00014991}
2023-05-24T14:53:11.183+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.183+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiBZlIQ5Bl8pYZ70EoDLuTK+UsVtmcWWa2XgERI58Ji77w=="}
2023-05-24T14:53:11.183+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqftfeehedf6klbt32bfaglxezl4uwfnwm4lftlmxqbcerz6cmlx3y"}
2023-05-24T14:53:11.184+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiBZlIQ5Bl8pYZ70EoDLuTK+UsVtmcWWa2XgERI58Ji77w==", "time": 0.00031029}
2023-05-24T14:53:11.184+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.184+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiAkPN2XsrdVYZuKIMRNPrTJnN2m3ORc6AYw9UEtHL4usA=="}
2023-05-24T14:53:11.184+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiAkPN2XsrdVYZuKIMRNPrTJnN2m3ORc6AYw9UEtHL4usA==", "time": 0.000161262}
2023-05-24T14:53:11.184+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiAkPN2XsrdVYZuKIMRNPrTJnN2m3ORc6AYw9UEtHL4usA==", "time": 0.000198732}
2023-05-24T14:53:11.185+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.185+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiAkPN2XsrdVYZuKIMRNPrTJnN2m3ORc6AYw9UEtHL4usA=="}
2023-05-24T14:53:11.185+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqcipg5s6zlovlbtofcbrcnh22mthg5u3ooixhiayypkqjnds7c5ma"}
2023-05-24T14:53:11.185+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiAkPN2XsrdVYZuKIMRNPrTJnN2m3ORc6AYw9UEtHL4usA==", "time": 0.000228748}
2023-05-24T14:53:11.185+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.185+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ=="}
2023-05-24T14:53:11.185+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ==", "time": 0.000148257}
2023-05-24T14:53:11.185+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ==", "time": 0.0001819}
2023-05-24T14:53:11.186+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.186+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ=="}
2023-05-24T14:53:11.186+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqorc35chgaczfdhtdz7nqxiicbdh37nvmp7fatfwa3l3bydz256yi"}
2023-05-24T14:53:11.186+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDoi30RzAFkozzHn7YXQgQRn39tWP+UEy2Btew4HnXfYQ==", "time": 0.000217346}
2023-05-24T14:53:11.186+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.186+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDLwfQ4s2NxvxQJZVLrRpeSdtoOvxw+GCoz5XWwv9x9LQ=="}
2023-05-24T14:53:11.186+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDLwfQ4s2NxvxQJZVLrRpeSdtoOvxw+GCoz5XWwv9x9LQ==", "time": 0.000153265}
2023-05-24T14:53:11.186+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiDLwfQ4s2NxvxQJZVLrRpeSdtoOvxw+GCoz5XWwv9x9LQ==", "time": 0.000208499}
2023-05-24T14:53:11.187+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.187+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDLwfQ4s2NxvxQJZVLrRpeSdtoOvxw+GCoz5XWwv9x9LQ=="}
2023-05-24T14:53:11.187+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqmxqpuhczwg4n7cqewkuxli2lze5w2b27rypqyfiz6k5nqx7oh2li"}
2023-05-24T14:53:11.187+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiDLwfQ4s2NxvxQJZVLrRpeSdtoOvxw+GCoz5XWwv9x9LQ==", "time": 0.000237554}
2023-05-24T14:53:11.187+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.188+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiCURbMmqidfjKplKLEEAoLL/EU9MDmZGJERhFnkRDQsYA=="}
2023-05-24T14:53:11.188+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiCURbMmqidfjKplKLEEAoLL/EU9MDmZGJERhFnkRDQsYA==", "time": 0.000193352}
2023-05-24T14:53:11.188+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:159	responded to message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 4, "key": "EiCURbMmqidfjKplKLEEAoLL/EU9MDmZGJERhFnkRDQsYA==", "time": 0.000236422}
2023-05-24T14:53:11.189+0200	DEBUG	dht	go-libp2p-kad-dht/dht.go:671	peer found	{"peer": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs"}
2023-05-24T14:53:11.189+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:116	handling message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiCURbMmqidfjKplKLEEAoLL/EU9MDmZGJERhFnkRDQsYA=="}
2023-05-24T14:53:11.189+0200	DEBUG	dht	go-libp2p-kad-dht/handlers.go:345	adding provider	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "key": "bciqjirnte2vcox4mvjssrmieakbmx7cfhuydtgiyseiyiwpeiq2cyya"}
2023-05-24T14:53:11.189+0200	DEBUG	dht	go-libp2p-kad-dht/dht_net.go:133	handled message	{"from": "12D3KooWSPb4DqHiUTtNP59AMu4Q4L2yW13iNTsV35TqXx1pZUfs", "type": 2, "key": "EiCURbMmqidfjKplKLEEAoLL/EU9MDmZGJERhFnkRDQsYA==", "time": 0.000265626}
2023-05-24T14:53:13.447+0200	DEBUG	basichost	basic/basic_host.go:338	failed to fetch local IPv6 address	{"error": "no route found for ::"}
2023-05-24T14:53:13.477+0200	DEBUG	bootstrap	bootstrap/bootstrap.go:142	12D3KooWJpqacxjCYHzbbcoutMAM98TUaDtRgDbvSTtsym72VZRp no more bootstrap peers to create 3 connections
2023-05-24T14:53:13.477+0200	DEBUG	bootstrap	bootstrap/bootstrap.go:90	12D3KooWJpqacxjCYHzbbcoutMAM98TUaDtRgDbvSTtsym72VZRp bootstrap error: not enough bootstrap peers to bootstrap
2023-05-24T14:53:14.501+0200	DEBUG	bs:sess	session/session.go:467	broadcastWantHaves	{"session": 2, "cids": [{"/":"QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg"}]}
2023-05-24T14:53:18.448+0200	DEBUG	basichost	basic/basic_host.go:338	failed to fetch local IPv6 address	{"error": "no route found for ::"}
2023-05-24T14:53:18.497+0200	DEBUG	blockservice	blockservice/blockservice.go:247	BlockService: Searching
2023-05-24T14:53:18.497+0200	DEBUG	bitswap	getter/getter.go:86	Bitswap.GetBlockRequest.Start	{"cid": "QmR5MGGSBpSXbh5v71ru5tys8Rvd2uX7ybeAwpbMxZztSg"}

Discordian · June 1, 2023, 5:08pm

The error you’re talking about is the one related to “could not get file with CID”? Is the node working as expected otherwise?

Brij · February 13, 2024, 6:50pm

facing the same error. Was a solution/cause found to this?

Thank you

daniel1302 · February 14, 2024, 9:15am

I did more debugging and experimenting. I found the problem is different. We distribute segments of the PostgreSQL data via IPFS. People often start our program behind the NAT.

I confirmed in multiple networks (AWS, DO, my home network, and another isolated network) that:

When I call ipfs get ... in most cases, it starts instantly but sometimes it is waiting and waiting and waiting until you cancel it and start it again, usually after a second time it is fine.

At the moment I did not have time to dig into this issue deeply so We have added a timeout + retry.

Our program is golang. We have also updated Kubo to the latest version (2 major versions). I will let you know if it solved the issue in 2 weeks(after release for our ipfs network) - it is hard to reproduce in our test networks.

Topic		Replies	Views
Can all bootstrap nodes be blocked? Help	2	737	March 4, 2020
Can't fetch files from other nodes Kubo go-ipfs	10	821	December 21, 2023
Multiple leader ipfs on cluster nodes? IPFS Cluster	5	565	April 15, 2019
IPFS Private Network local peers discovery issue Help go-ipfs	2	389	December 28, 2022
0.4.23 vs 0.6.0 peer connection management Help go-ipfs	2	299	September 21, 2020