etcd 集群运维实践

2023年 7月 9日 41.4k 0

你好,请教一下。我的服务器异常关机,导致etcd集群无法启动。三个节点的报错都是快照文件不存在,没有做过备份,要怎么处理呢?
环境:
CentOS Linux release 7.4.1708 (Core)
etcd Version: 3.3.10

报错日志:
Mar 05 11:01:05 k8s01.test systemd[1]: Starting Etcd Server…
Mar 05 11:01:05 k8s01.test etcd[902]: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=https://192.168.88.101:2380
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_CLIENT_CERT_AUTH, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_KEY_FILE, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_CERT_FILE, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_INITIAL_CLUSTER_STATE, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_PEER_TRUSTED_CA_FILE, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_INITIAL_CLUSTER, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_PEER_KEY_FILE, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_INITIAL_CLUSTER_TOKEN, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_TRUSTED_CA_FILE, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_LISTEN_PEER_URLS, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_PEER_CERT_FILE, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_NAME, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_ADVERTISE_CLIENT_URLS, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_DATA_DIR, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_LISTEN_CLIENT_URLS, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: recognized environment variable ETCD_PEER_CLIENT_CERT_AUTH, but unused: shadowed by corresponding flag
Mar 05 11:01:05 k8s01.test etcd[902]: etcd Version: 3.3.10
Mar 05 11:01:05 k8s01.test etcd[902]: Git SHA: 27fc7e2
Mar 05 11:01:05 k8s01.test etcd[902]: Go Version: go1.10.4
Mar 05 11:01:05 k8s01.test etcd[902]: Go OS/Arch: linux/amd64
Mar 05 11:01:05 k8s01.test etcd[902]: setting maximum number of CPUs to 1, total number of available CPUs is 1
Mar 05 11:01:05 k8s01.test etcd[902]: the server is already initialized as member before, starting as etcd member…
Mar 05 11:01:05 k8s01.test etcd[902]: peerTLS: cert = /k8s/etcd/ssl/server.pem, key = /k8s/etcd/ssl/server-key.pem, ca = , trusted-ca = /k8s/etcd/ssl/ca.pem, client-cert-auth = true, crl-fi
Mar 05 11:01:05 k8s01.test etcd[902]: listening for peers on https://192.168.88.101:2380
Mar 05 11:01:05 k8s01.test etcd[902]: listening for client requests on 192.168.88.101:2379
Mar 05 11:01:05 k8s01.test etcd[902]: recovered store from snapshot at index 400004
Mar 05 11:01:05 k8s01.test etcd[902]: recovering backend from snapshot error: database snapshot file path error: snap: snapshot file doesn’t exist
Mar 05 11:01:05 k8s01.test bash[902]: panic: recovering backend from snapshot error: database snapshot file path error: snap: snapshot file doesn’t exist
Mar 05 11:01:05 k8s01.test bash[902]: panic: runtime error: invalid memory address or nil pointer dereference
Mar 05 11:01:05 k8s01.test bash[902]: [signal SIGSEGV: segmentation violation code=0x1 addr=0x20 pc=0xb8cb90]
Mar 05 11:01:05 k8s01.test bash[902]: goroutine 1 [running]:
Mar 05 11:01:05 k8s01.test bash[902]: github.com/coreos/etcd/cmd/vendor/github.com/coreos/etcd/etcdserver.NewServer.func1(0xc4201dfca0, 0xc4201df758)
Mar 05 11:01:05 k8s01.test bash[902]: /tmp/etcd-release-3.3.10/etcd/release/etcd/gopath/src/github.com/coreos/etcd/cmd/vendor/github.com/coreos/etcd/etcdserver/server.go:291 +0x40
Mar 05 11:01:05 k8s01.test bash[902]: panic(0xde0ce0, 0xc420237a40)
Mar 05 11:01:05 k8s01.test bash[902]: /usr/local/go/src/runtime/panic.go:502 +0x229
Mar 05 11:01:05 k8s01.test bash[902]: github.com/coreos/etcd/cmd/vendor/github.com/coreos/pkg/capnslog.(*PackageLogger).Panicf(0xc4201b29c0, 0xfe8789, 0x2a, 0xc4201df7f8, 0x1, 0x1)
Mar 05 11:01:05 k8s01.test bash[902]: /tmp/etcd-release-3.3.10/etcd/release/etcd/gopath/src/github.com/coreos/etcd/cmd/vendor/github.com/coreos/pkg/capnslog/pkg_logger.go:75 +0x162
Mar 05 11:01:05 k8s01.test bash[902]: github.com/coreos/etcd/cmd/vendor/github.com/coreos/etcd/etcdserver.NewServer(0x7ffc28794999, 0x6, 0x0, 0x0, 0x0, 0x0, 0xc420111400, 0x1, 0x1, 0xc42011
Mar 05 11:01:05 k8s01.test bash[902]: /tmp/etcd-release-3.3.10/etcd/release/etcd/gopath/src/github.com/coreos/etcd/cmd/vendor/github.com/coreos/etcd/etcdserver/server.go:386 +0x26bb
Mar 05 11:01:05 k8s01.test bash[902]: github.com/coreos/etcd/cmd/vendor/github.com/coreos/etcd/embed.StartEtcd(0xc42021e000, 0xc42021e480, 0x0, 0x0)
Mar 05 11:01:05 k8s01.test bash[902]: /tmp/etcd-release-3.3.10/etcd/release/etcd/gopath/src/github.com/coreos/etcd/cmd/vendor/github.com/coreos/etcd/embed/etcd.go:179 +0x811
Mar 05 11:01:05 k8s01.test bash[902]: github.com/coreos/etcd/cmd/vendor/github.com/coreos/etcd/etcdmain.startEtcd(0xc42021e000, 0xfc62b7, 0x6, 0xc4201e0d01, 0x2)
Mar 05 11:01:05 k8s01.test bash[902]: /tmp/etcd-release-3.3.10/etcd/release/etcd/gopath/src/github.com/coreos/etcd/cmd/vendor/github.com/coreos/etcd/etcdmain/etcd.go:181 +0x40
…skipping…

fy_starstar4年前 (2019-03-05)登录以回复

相关文章

KubeSphere 部署向量数据库 Milvus 实战指南
探索 Kubernetes 持久化存储之 Longhorn 初窥门径
征服 Docker 镜像访问限制!KubeSphere v3.4.1 成功部署全攻略
那些年在 Terraform 上吃到的糖和踩过的坑
无需 Kubernetes 测试 Kubernetes 网络实现
Kubernetes v1.31 中的移除和主要变更

发布评论