After rebooting Kubernetes’ nodes there is an issue:
kubectl describe pod cockroach-cockroachdb-0
Type Reason Age From Message
Warning Unhealthy 49s (x2638 over 3h) kubelet, lab-arp-node2 Readiness probe failed: HTTP probe failed with statuscode: 503
I can enter into pod cockroach-cockroachdb-0, ‘cockroach sql --insecure’ doesn’t work.
‘./cockroach init --insecure’ leads to:
Error: rpc error: code = AlreadyExists desc = cluster has already been initialized with ID …
Is there any way to debug it? Why does it happen?
P.S. There are 3 cockroach nodes. One kubernetes node was in NotReady state, there was unstable work with db. Kubernetes nodes were restarted. After that we have 503 issue.