k8s集群报错
1.内存不够报错信息May7 04:02:26 k8smaster containerd: time="2022-05-07T04:02:26.763885030+08:00" level=error msg="copy shim log" error="read /proc/self/fd/27: file already closed"初步怀疑是内存出现问题free -h脚本检查后发现总共内存
·
1.内存不够
报错信息
May 7 04:02:26 k8smaster containerd: time="2022-05-07T04:02:26.763885030+08:00" level=error msg="copy shim log" error="read /proc/self/fd/27: file already closed"
初步怀疑是内存出现问题
free -h
脚本检查后发现
总共内存:251G
使用内存:169G
剩余内存:1.4G
内存剩余:0.55
内存使用:67.48
内存剩余不多了
清理内存
sync #先把内存中的数据进行读写到磁盘中,多执行几次
echo 3 > /proc/sys/vm/drop_caches #释放内存
total used free shared buff/cache available
Mem: 251G 168G 78G 4.0G 4.7G 77G
Swap: 0B 0B 0B
2.租约报错
Apr 27 21:43:40 k8smaster kubelet: E0427 21:43:40.133068 113941 kubelet.go:2291] "Error getting node" err="node \"k8smaster\" not found"
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.155698 113941 kubelet_node_status.go:71] "Attempting to register node" node="k8smaster"
Apr 27 21:43:40 k8smaster dockerd: time="2022-04-27T21:43:40.161099645+08:00" level=error msg="Not continuing with pull after error: error creating lease: context canceled"
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.172788 113941 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="networkPlugin cni failed on the status hook for pod \"dashboard-metrics-scraper-856586f554-2hx4f_kubernetes-dashboard\": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container \"34bf60d655f5addca7e579bcf1869b817e8c49d34ccfb978af7f16d2d1c0bff6\""
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.176984 113941 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="networkPlugin cni failed on the status hook for pod \"dashboard-metrics-scraper-856586f554-2hx4f_kubernetes-dashboard\": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container \"d1b953f31241261e4c469a52763af5663c508a62134f462d643558a484bf33d3\""
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.227094 113941 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="networkPlugin cni failed on the status hook for pod \"coredns-558bd4d5db-4j8nv_kube-system\": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container \"3213f8a980cd0eb599b12248033c46e5c227180a30f986cda94af0acff6d5467\""
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.229381 113941 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="networkPlugin cni failed on the status hook for pod \"coredns-558bd4d5db-4j8nv_kube-system\": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container \"b1b9a57d7ebe974fd71dbe86e3271aaa75cac6e513d82135a5e5f1df4201f090\""
Apr 27 21:43:40 k8smaster kubelet: E0427 21:43:40.233426 113941 kubelet.go:2291] "Error getting node" err="node \"k8smaster\" not found"
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.249893 113941 scope.go:111] "RemoveContainer" containerID="e6e7eb170618af3591f6fc3f40c2f7c3776d21954acfe19a043b4c3eff2d25ad"
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.265341 113941 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="networkPlugin cni failed on the status hook for pod \"kubernetes-dashboard-67484c44f6-7zgwn_kubernetes-dashboard\": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container \"905002a60acbffdadb87782f568faaa7cb05c30477a0b96f14f14f3b25406ead\""
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.267796 113941 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="networkPlugin cni failed on the status hook for pod \"kubernetes-dashboard-67484c44f6-7zgwn_kubernetes-dashboard\": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container \"f8666efdd85e7de0ddb9ae3fcb0491aa9c03b8562a8582962c9e41e053602200\""
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.287029 113941 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="networkPlugin cni failed on the status hook for pod \"coredns-558bd4d5db-fl9lp_kube-system\": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container \"70915cac633ade99a6ac1575dd97ccb2b9cae5d9c1a199e0d31d7331a75fb0c9\""
Apr 27 21:43:40 k8smaster kubelet: I0427 21:43:40.289279 113941 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="networkPlugin cni failed on the status hook for pod \"coredns-558bd4d5db-fl9lp_kube-system\": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container \"ce361c6004713dbc9bf88d2e0ede746799ecf484e1561e0e7dee6639e5a6cdd3\""
主要的报错解释第三行
进行k8s的租约更
注:更新前把以前的证书进行备份
cd /etc/kubernetes/
cp -rapf pki k8szs.bak
kubeadm certs renew all
更多推荐
已为社区贡献6条内容
所有评论(0)