Ipfs-cluster-service daemon error loading configurations: could not fetch configuration from source

marcoi · June 5, 2020, 12:09pm

In Ubuntu 18.04.4 Desktop I initialized ipfs-cluster as follows:

(base) marco@pc01:~$ ipfs-cluster-service init --consensus crdt --custom-secret   
23a....... \

–peers Qm…,Qm…
https://ggc.world
2020-06-05T11:30:04.743+0200 INFO config config/config.go:481 Saving configuration
configuration written to /home/marco/.ipfs-cluster/service.json.
2020-06-05T11:30:04.743+0200 INFO config config/identity.go:73 Saving identity
new identity written to /home/marco/.ipfs-cluster/identity.json
new empty peerstore written to .
(base) marco@pc01:~$

But when trying to run the ipfs cluster peer I get this error:

(base) marco@pc01:~$ ipfs-cluster-service daemon
2020-06-05T13:08:41.176+0200 INFO service ipfs-cluster-service/daemon.go:46 Initializing. For verbose output run with “-l debug”. Please wait…
2020-06-05T13:08:41.176+0200 INFO config config/config.go:361 loading configuration from 23a…
error loading configurations: could not fetch configuration from source: 23a…
(base) marco@pc01:~$

How to solve the problem?
Looking forward to your kind help.
Marco

hector · June 5, 2020, 12:54pm

The --custom-secret flag prompts for the secret interactively. If you wish to set it automatically you need to set the CLUSTER_SECRET environment variable.

The way you called the command, the secret is being interpreted as the [http-source-url] part. Because you are providing a “source-url”, the secret is not being prompted. I realize this is not the best UX and the command should have failed in the first place.

marcoi · June 5, 2020, 1:12pm

Hi Hector!
Thank your for your kind reply.

So, if I understand correctly, I just need to put into .bashrc file export CLUSTER_SECRET=“23a…” and then run ipfs-cluster-service init .

Actually one more thing I actually do not undertand how to proceed in initializing the ipfs-cluster, the remote configuration part. May be it is a step forward, but it would be nice to use a remote configuration file accessible on an HTTP(s) location. But how to concretely do it?

marcoi · June 5, 2020, 1:36pm

Third question:

doing ipfs-cluster-service init --help I read: “–peers value comma-separated list of multiaddresses to init with”

But I got :

(base) marco@pc01:~$ ipfs-cluster-service init --consensus crdt --peers Qm…,Qm…
error parsing peer multiaddress: Qm…: failed to parse multiaddr “Qm…”: must begin with /

So I tried

(base) marco@pc01:~$ ipfs-cluster-service init --consensus crdt --peers /Qm…,/Qm…
error parsing peer multiaddress: /Qm…: failed to parse multiaddr “/Qm…”: unknown protocol Qm…

So, I guess I do not understand properly how to proceed

marcoi · June 5, 2020, 2:17pm

@hector When initializing without specifying the peers , I’m actually able to run the daemon:

(base) marco@pc01:~$ ipfs-cluster-service init --consensus crdt
2020-06-05T15:54:37.189+0200	INFO	config	config/config.go:481	Saving configuration
configuration written to /home/marco/.ipfs-cluster/service.json.
2020-06-05T15:54:37.190+0200	INFO	config	config/identity.go:73	Saving identity
new identity written to /home/marco/.ipfs-cluster/identity.json
new empty peerstore written to /home/marco/.ipfs-cluster/peerstore.


(base) marco@pc01:~$ ipfs-cluster-service daemon
2020-06-05T16:06:04.901+0200	INFO	service	ipfs-cluster-service/daemon.go:46	Initializing.    
For verbose output run with "-l debug". Please wait...
2020-06-05T16:06:04.930+0200	INFO	cluster	ipfs-cluster@v0.13.0/cluster.go:132	IPFS     
Cluster v0.13.0 listening on:
        /ip4/127.0.0.1/tcp/9096
/p2p/12D3KooWMVhpQXrGhu7m5UCJHusiUJxLxieEJHFQuFiYpRfAWY2X
        /ip4/192.168.1.7/tcp/9096    
/p2p/12D3KooWMVhpQXrGhu7m5UCJHusiUJxLxieEJHFQuFiYpRfAWY2X
        /ip4/172.17.0.1/tcp/9096   
/p2p/12D3KooWMVhpQXrGhu7m5UCJHusiUJxLxieEJHFQuFiYpRfAWY2X


2020-06-05T16:06:04.931+0200	INFO	restapi	rest/restapi.go:515	REST API (HTTP): 
/ip4/127.0.0.1/tcp/9094
2020-06-05T16:06:04.931+0200	INFO	ipfsproxy	ipfsproxy/ipfsproxy.go:320	IPFS Proxy: 
/ip4/127.0.0.1/tcp/9095 -> /ip4/127.0.0.1/tcp/5001
2020-06-05T16:06:04.931+0200	INFO	crdt	go-ds-crdt@v0.1.12/crdt.go:275	crdt Datastore
created. Number of heads: 0. Current max-height: 0
2020-06-05T16:06:04.931+0200	INFO	crdt	crdt/consensus.go:272	'trust all' mode 
enabled. Any peer in the cluster can modify the pinset.
2020-06-05T16:06:04.934+0200	INFO	cluster	ipfs-cluster@v0.13.0/cluster.go:619	Cluster 
Peers (without including ourselves):
2020-06-05T16:06:04.934+0200	INFO	cluster	ipfs-cluster@v0.13.0/cluster.go:621	    - No 
other peers
2020-06-05T16:06:04.934+0200	INFO	cluster	ipfs-cluster@v0.13.0/cluster.go:634	** IPFS 
Cluster is READY **

So… my question is : how to correctly specify during the initialization phase the peers and, possibly, the remote configuration file?

frankTheTank72 · June 5, 2020, 3:13pm

Hi just how I did it :

Use the service.json from your trusted peer(s) and create the service.json for your followers
Pin the follower service.json to your ipfs from one of your trusted peers
Add the QM… to your cluster via ipfs-cluster-ctl pin add QM…

Now your service.json for your followers is pinned in the IPFS space

Call to for init the follower :

ipfs-cluster-follow YourCluster-Name init http://127.0.0.1:8080/ipfs/Qm…

done

marcoi · June 5, 2020, 4:09pm

Thank you Frank for explaining me how to add followers to my cluster.
Actually I was two steps behind, in trying to understand how to add a “normal” peer to the cluster, which I did without pain, this time.

At the moment I do not have a third laptop/pc to install another peer and try to add it as follower.
But I will try for sure.

frankTheTank72 · June 5, 2020, 4:18pm

yes works pretty cool after you have installed your main-cluster - enjoy

hector · June 5, 2020, 4:19pm

You wouldn’t put this in your .bashrc. You would just export CLUSTER_SECRET=xxx directly before running the init command.

Once you create a service.json configuration file, you can host it in a web location and initialize peers using that web location. You can also use IPFS for hosting. This is related: Hosting a collaborative cluster - Pinset orchestration for IPFS

You are just passing peer IDs, not multiaddresses. Multiaddresses are like /ip4/x.x.x.x/tcp/9096/p2p/<peerID>. There are some examples here: Download and setup - Pinset orchestration for IPFS.

marcoi · June 5, 2020, 4:38pm

Thank you for your kind explanation

Topic		Replies	Views
Help: Systemd file for IPFS Cluster Service Help ipfs-cluster	7	1776	June 23, 2020
IPFS Cluster How-to: please review! IPFS Cluster ipfs-cluster	20	1385	June 5, 2020
Need IPFS Installation Documents	2	293	May 17, 2022
Can't start IPFS daemon - ipfs.service: Failed with result 'exit-code' Help	5	178	August 15, 2023
`ipfs id` != /.ipfs/config after migration to go-ipfs 0.5.0 Help go-ipfs	3	356	May 5, 2020

Ipfs-cluster-service daemon error loading configurations: could not fetch configuration from source

Related Topics