Problem starting a cluster: Gossip error

Hi,
I’m trying to start a 3-node cluster. I checked the cockroach logs after I did ‘cockroach start’ on the 3 nodes. All of them I see the following errors:

I171207 07:03:44.983621 1430 gossip/client.go:129 [n?] started gossip client to 10.10.16.181:26257
I171207 07:03:44.983892 1430 gossip/client.go:136 [n?] closing client to 10.10.16.181:26257: rpc error: code = Unimplemented desc = unknown service cockroach.gossip.Gossip

I used the latest downloaded linux binary cockroach-v1.1.3.linux-amd64 on the nodes.

Hi Joel, what happens when you access the admin UI? Is your cluster down? It is possible that your network ports have not been configured properly. Are you able to ping all the clients in your cluster, and are they connected to each other?

Did you provide --join flags to all three of the nodes? If so, you need to run the cockroach init command in order to initialize your cluster, as described here: https://www.cockroachlabs.com/docs/stable/initialize-a-cluster.html

I think this might be transient errors when trying to create the cluster. I was able to do ‘cockroach init’ to initialize the cluster and the operation seemed normal afterwards. But my log is filled with messages like the following before I ran ‘cockroach init’:
I171207 07:14:17.225701 4366 gossip/client.go:129 [n?] started gossip client to 10.10.16.181:26257
I171207 07:14:17.226117 4366 gossip/client.go:136 [n?] closing client to 10.10.16.181:26257: rpc error: code = Unimplemented desc = unknown service cockroach.gossip.Gossip

Maybe the message could have Benn something like:
‘cannot reach peer…’ instead?

Ah, well in that case, and @a-robinson can correct me if I mispeak, that is expected behavior. Your cluster won’t start up until after you run cockroach init. However, you’ve rightly pointed out that we should probably have better log messages in that scenario (perhaps something like, nodes initialized but not yet joined, run cockroach init).

Here’s the issue: https://github.com/cockroachdb/cockroach/issues/20559